[ 622.790353] env[70520]: INFO neutron.common.config [-] Logging enabled! [ 622.790602] env[70520]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev38 [ 622.790854] env[70520]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=70520) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 622.791183] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 622.791314] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 622.792330] env[70520]: WARNING oslo_policy.policy [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 622.792592] env[70520]: WARNING oslo_policy.policy [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 622.794135] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] VMware NSXv3 Agent initialized successfully. [ 622.794520] env[70520]: DEBUG oslo_concurrency.lockutils [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] Acquiring lock "singleton_lock" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.794710] env[70520]: DEBUG oslo_concurrency.lockutils [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] Acquired lock "singleton_lock" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.794934] env[70520]: DEBUG oslo_concurrency.lockutils [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] Releasing lock "singleton_lock" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.795352] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] Full set of CONF: {{(pid=70520) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 622.795480] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ******************************************************************************** {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 622.795596] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] Configuration options gathered from: {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 622.795876] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 622.796056] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 622.796170] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ================================================================================ {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 622.796343] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] agent_down_time = 75 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.796491] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] allow_automatic_dhcp_failover = True {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.796733] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] allow_bulk = True {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.796856] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] api_extensions_path = {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.796909] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] api_paste_config = api-paste.ini {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.797065] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] auth_strategy = keystone {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.797176] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] backdoor_port = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.797282] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] backdoor_socket = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.797430] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] backlog = 4096 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.797583] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] base_mac = fa:16:3e:00:00:00 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.797752] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] bind_host = 0.0.0.0 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.797896] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] bind_port = 9696 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.798045] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] client_socket_timeout = 900 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.798192] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] config_dir = [] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.798307] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.798453] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] config_source = [] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.798599] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] control_exchange = neutron {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.798743] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] core_plugin = ml2 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.798886] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] debug = True {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.799042] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] default_availability_zones = [] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.799258] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.799404] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] dhcp_agent_notification = True {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.799546] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] dhcp_agents_per_network = 1 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.799685] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] dhcp_lease_duration = 86400 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.799844] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] dhcp_load_type = networks {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.800098] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] dns_domain = openstacklocal {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.800283] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.800427] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] enable_default_route_bfd = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.800570] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] enable_default_route_ecmp = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.800710] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] enable_dvr = True {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.800849] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] enable_new_agents = True {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.800987] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.801138] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] enable_signals = True {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.801274] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] enable_traditional_dhcp = True {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.801430] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] external_dns_driver = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.801579] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] filter_validation = True {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.801729] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] global_physnet_mtu = 8950 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.801867] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] graceful_shutdown_timeout = 60 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.802067] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] host = cpu-1 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.802215] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] host_dvr_for_dhcp = True {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.802353] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] http_retries = 3 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.802497] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] instance_format = [instance: %(uuid)s] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.802637] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.802776] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ipam_driver = internal {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.802912] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ipv6_pd_enabled = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.803062] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] l3_ha = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.803207] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.803373] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] l3_ha_network_physical_name = {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.803523] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] l3_ha_network_type = {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.803671] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] log_color = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.803812] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] log_config_append = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.803954] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.804105] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] log_dir = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.804242] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] log_file = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.804352] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] log_options = True {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.804513] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] log_rotate_interval = 1 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.804674] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] log_rotate_interval_type = days {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.804809] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] log_rotation_type = none {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.804920] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.805040] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.805188] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.805331] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.805437] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.805579] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] max_dns_nameservers = 5 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.805713] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] max_header_line = 16384 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.805850] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] max_l3_agents_per_router = 3 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.805985] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] max_logfile_count = 30 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.806131] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] max_logfile_size_mb = 200 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.806265] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] max_subnet_host_routes = 20 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.806408] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] my_ip = 10.180.1.21 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.806550] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] my_ipv6 = ::1 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.806688] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] network_auto_schedule = True {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.806896] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] network_link_prefix = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.807010] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.807108] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] notify_nova_on_port_data_changes = True {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.807252] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] notify_nova_on_port_status_changes = True {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.807396] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] pagination_max_limit = -1 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.807533] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] publish_errors = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.807668] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] rate_limit_burst = 0 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.807809] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] rate_limit_except_level = CRITICAL {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.807942] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] rate_limit_interval = 0 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.808092] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] retry_until_window = 30 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.808229] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] router_distributed = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.808363] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] rpc_resources_processing_step = 20 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.808499] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] rpc_response_max_timeout = 600 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.808634] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] rpc_response_timeout = 60 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.808770] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] send_events_interval = 2 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.808926] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] service_plugins = ['router'] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.809079] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] setproctitle = on {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.809211] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] shell_completion = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.809352] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] state_path = /opt/stack/data/neutron {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.809492] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] syslog_log_facility = LOG_USER {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.809628] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] tcp_keepidle = 600 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.809767] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] transport_url = **** {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.809905] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] use_journal = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.810042] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] use_json = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.810179] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] use_ssl = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.810310] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] use_stderr = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.810451] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] use_syslog = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.810591] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] vlan_qinq = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.810725] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] vlan_transparent = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.810855] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] watch_log_file = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.810995] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] wsgi_default_pool_size = 100 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.811142] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] wsgi_keep_alive = True {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.811288] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.811454] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] wsgi_server_debug = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.811626] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_concurrency.disable_process_locking = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.811777] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.811922] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.812073] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.812221] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.812364] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.812506] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.812660] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] profiler.connection_string = messaging:// {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.812807] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] profiler.enabled = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.812952] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] profiler.es_doc_type = notification {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.813105] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] profiler.es_scroll_size = 10000 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.813250] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] profiler.es_scroll_time = 2m {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.813429] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] profiler.filter_error_trace = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.813582] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] profiler.hmac_keys = **** {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.813725] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] profiler.sentinel_service_name = mymaster {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.813872] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] profiler.socket_timeout = 0.1 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.814016] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] profiler.trace_requests = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.814156] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] profiler.trace_sqlalchemy = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.814309] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] profiler_jaeger.process_tags = {} {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.814457] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] profiler_jaeger.service_name_prefix = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.814611] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] profiler_otlp.service_name_prefix = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.814766] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_policy.enforce_new_defaults = True {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.815063] env[70520]: WARNING oslo_config.cfg [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 622.815219] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_policy.enforce_scope = True {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.815366] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_policy.policy_default_rule = default {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.815526] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.815717] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.815841] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.815948] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.816095] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.816228] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.816365] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.816511] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.816661] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.816810] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] agent.extensions = [] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.816959] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.817142] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] service_providers.service_provider = [] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.817247] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] QUOTAS.default_quota = -1 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.817390] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.817529] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] QUOTAS.quota_floatingip = 50 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.817669] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] QUOTAS.quota_network = 100 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.817803] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] QUOTAS.quota_port = 500 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.817938] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.818086] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] QUOTAS.quota_router = 10 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.818226] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] QUOTAS.quota_security_group = 10 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.818367] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.818504] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] QUOTAS.quota_subnet = 100 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.818640] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] QUOTAS.track_quota_usage = True {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.818788] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.818921] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep.group = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.819064] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep.helper_command = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.819203] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.819339] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep.thread_pool_size = 8 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.819472] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep.user = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.819613] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.819744] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_dhcp_release.group = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.819873] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_dhcp_release.helper_command = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.820025] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.820152] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.820308] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_dhcp_release.user = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.820418] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.820549] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_ovs_vsctl.group = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.820678] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_ovs_vsctl.helper_command = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.820815] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.820948] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.821089] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_ovs_vsctl.user = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.821228] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_namespace.capabilities = [21] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.821381] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_namespace.group = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.821529] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_namespace.helper_command = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.821670] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.821806] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_namespace.thread_pool_size = 8 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.821937] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_namespace.user = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.822088] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_conntrack.capabilities = [12] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.822224] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_conntrack.group = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.822357] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_conntrack.helper_command = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.822497] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.822625] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.822791] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_conntrack.user = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.822895] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_link.capabilities = [12, 21] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.823033] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_link.group = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.823167] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_link.helper_command = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.823303] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.823465] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_link.thread_pool_size = 8 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.823604] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] privsep_link.user = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.823765] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.823901] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.824050] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] AGENT.continue_on_failed_promotions = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.824187] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] AGENT.dscp = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.824323] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] AGENT.dscp_inherit = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.824490] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] AGENT.force_mp_to_policy = True {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.824630] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] AGENT.locking_coordinator_url = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.824769] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] AGENT.log_agent_heartbeats = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.824904] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] AGENT.logging_expire = 1 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.825060] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.825199] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.825342] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] AGENT.polling_interval = 240 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.825480] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.825621] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.825764] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] AGENT.report_interval = 30.0 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.825907] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.826058] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.826203] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.826342] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] AGENT.sync_skew = 60 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.826480] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] AGENT.synchronization_queue_size = 20 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.826619] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] AGENT.use_helper_for_ns_read = True {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.826763] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] SECURITYGROUP.enable_ipset = True {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.826994] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] SECURITYGROUP.enable_security_group = True {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.827158] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.827301] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.827449] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] experimental.ipv6_pd_enabled = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.827669] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ml2.extension_drivers = ['port_security'] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.827857] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ml2.external_network_type = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.828031] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.828185] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ml2.overlay_ip_version = 4 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.828330] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ml2.path_mtu = 8950 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.828475] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ml2.physical_network_mtus = {} {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.828627] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ml2.tenant_network_types = ['vlan'] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.828773] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.828920] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ml2.type_drivers = ['vlan'] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.829078] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] AGENT_CLI.neutron_port_id = [] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.829219] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.829356] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.829504] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.829648] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.829795] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.829989] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.830166] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.830315] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.830515] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.830670] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] NSXV3.nsxv3_login_password = **** {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.830818] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] NSXV3.nsxv3_login_port = 443 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.830960] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] NSXV3.nsxv3_login_user = admin {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.831116] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.831261] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.831426] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.831582] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.831728] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.831877] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.832033] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.832180] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.832320] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.832465] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.832619] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.832754] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.832896] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.833108] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.833260] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] vsphere.vsphere_login_password = VMware1! {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.833428] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.833577] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.833719] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] nova.auth_section = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.833871] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] nova.auth_type = password {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.834020] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.834194] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] nova.certfile = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.834294] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] nova.collect_timing = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.834536] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] nova.endpoint_type = public {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.834601] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] nova.insecure = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.834719] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] nova.keyfile = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.834864] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] nova.region_name = RegionOne {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.835020] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] nova.split_loggers = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.835156] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] nova.timeout = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.835298] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] placement.auth_section = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.835444] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] placement.auth_type = password {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.835588] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.835720] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] placement.certfile = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.835857] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] placement.collect_timing = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.835999] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] placement.endpoint_type = public {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.836154] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] placement.insecure = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.836288] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] placement.keyfile = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.836421] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] placement.region_name = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.836557] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] placement.split_loggers = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.836688] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] placement.timeout = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.836828] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ironic.auth_section = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.836966] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ironic.auth_type = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.837109] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ironic.cafile = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.837240] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ironic.certfile = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.837380] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ironic.collect_timing = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.837531] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ironic.connect_retries = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.837647] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ironic.connect_retry_delay = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.837783] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ironic.enable_notifications = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.837916] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ironic.endpoint_override = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.838058] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ironic.insecure = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.838195] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ironic.interface = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.838324] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ironic.keyfile = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.838455] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ironic.max_version = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.838586] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ironic.min_version = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.838716] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ironic.region_name = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.838849] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ironic.retriable_status_codes = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.838981] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ironic.service_name = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.839125] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ironic.service_type = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.839264] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ironic.split_loggers = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.839426] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ironic.status_code_retries = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.839521] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ironic.status_code_retry_delay = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.839651] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ironic.timeout = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.839786] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ironic.valid_interfaces = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.839916] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ironic.version = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.840068] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] cli_script.dry_run = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.840217] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.840353] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.840492] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.840627] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.840760] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.840891] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.841034] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.841174] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.841309] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.841483] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.841624] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.841768] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.841911] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.842067] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.842209] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.842355] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.842495] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.842632] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.842773] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.842908] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.843099] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.843245] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.843425] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.843575] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.843713] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.843853] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.843991] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.844143] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.844280] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.844417] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.844577] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.ssl = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.844722] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.844862] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.844999] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.845156] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.845295] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.845436] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.845582] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_notifications.driver = [] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.845722] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_notifications.retry = -1 {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.845875] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.846017] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.846135] env[70520]: DEBUG oslo_service.backend.eventlet.service [None req-3aefd7c1-2371-4952-a7f7-03a872f834b6 None None] ******************************************************************************** {{(pid=70520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 622.847133] env[70520]: DEBUG neutron.agent.securitygroups_rpc [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Init firewall settings (driver=nsxv3) {{(pid=70520) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 622.848429] env[70520]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=70520) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 622.848712] env[70520]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] RPC agent_id: nsxm-l-01a.corp.local [ 622.850926] env[70520]: DEBUG dogpile.cache.region [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 622.851068] env[70520]: DEBUG dogpile.lock [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 622.851169] env[70520]: DEBUG dogpile.lock [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 622.851261] env[70520]: DEBUG dogpile.lock [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 622.851370] env[70520]: DEBUG dogpile.cache.region [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 622.851473] env[70520]: DEBUG dogpile.lock [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 622.851601] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 622.896071] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Session token - acquiring [ 622.897968] env[70520]: DEBUG networking_nsxv3.common.locking [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.898204] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.898272] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.898716] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.909486] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.191678] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 623.221167] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 623.221322] env[70520]: DEBUG dogpile.cache.region [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Cache value generated in 0.370 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 623.221447] env[70520]: DEBUG dogpile.lock [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 623.221549] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Activating Policy API Provider. [ 623.221747] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Looking for the default Infrastructure Rules. [ 623.299355] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Looking for the Default Layer3 Logged Drop Section. [ 623.314640] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 623.315110] env[70520]: DEBUG networking_nsxv3.common.locking [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.315287] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Acquiring lock "all" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.315394] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Acquired lock "all" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.315718] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Acquired external semaphore "all" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.316063] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.831682] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.333802] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.836317] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Inventory metadata is going to be refreshed. [ 624.836698] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 625.748999] env[70520]: DEBUG networking_nsxv3.common.locking [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.749260] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.749402] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.749652] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.760491] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 625.761430] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.762277] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 625.781664] env[70520]: DEBUG networking_nsxv3.common.locking [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.781887] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.782040] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.782269] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.782394] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.782551] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 625.782666] env[70520]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=70520) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 625.782773] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 625.802093] env[70520]: DEBUG networking_nsxv3.common.locking [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.802356] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.802445] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.802676] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.802855] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.802998] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 625.829311] env[70520]: DEBUG networking_nsxv3.common.locking [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.829516] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.829656] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.829897] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.830061] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.830214] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 625.849899] env[70520]: DEBUG networking_nsxv3.common.locking [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.850376] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Acquiring lock "Address Group" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.850376] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Acquired lock "Address Group" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.850495] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Acquired external semaphore "Address Group" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.850618] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Releasing lock "Address Group" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.850770] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 625.850876] env[70520]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=70520) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 625.850981] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 625.869016] env[70520]: DEBUG networking_nsxv3.common.locking [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.869218] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Acquiring lock "Segment QoS" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.869351] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Acquired lock "Segment QoS" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.869614] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Acquired external semaphore "Segment QoS" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.869740] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Releasing lock "Segment QoS" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.869883] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 625.869991] env[70520]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=70520) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 625.870114] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 625.891812] env[70520]: DEBUG networking_nsxv3.common.locking [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.892077] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.892202] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.892397] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.892536] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.892683] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 625.892789] env[70520]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70520) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 625.892889] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Inventory metadata have been refreshed. [ 625.892986] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Dryrun:True. Metadata refresh completed. [ 625.893114] env[70520]: DEBUG oslo_concurrency.lockutils [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Releasing lock "all" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.895012] env[70520]: INFO neutron.agent.agent_extensions_manager [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Loaded agent extensions: [] [ 625.895791] env[70520]: DEBUG neutron_lib.callbacks.manager [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=70520) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 625.950881] env[70520]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] NSXv3 Agent Agent RPC Daemon Started! [ 625.951042] env[70520]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] NSXv3 Agent Agent loop - iteration:0 started [ 625.951169] env[70520]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] NSXv3 Agent Agent out of sync with plugin! [ 630.896442] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 630.896836] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 635.897780] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 635.897780] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 640.761114] env[70520]: INFO networking_nsxv3.common.synchronization [None req-f4d5149c-6efb-4937-a0cd-683b3864c423 demo admin] Enqueued Resource ID: d3e2acf5-3909-455f-abdb-485a8576e43e with Priority: HIGHEST for action security_group_rules [ 640.761757] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3e2acf5-3909-455f-abdb-485a8576e43e with Priority: HIGHEST for action security_group_rules [ 640.762017] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3e2acf5-3909-455f-abdb-485a8576e43e taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.762151] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3e2acf5-3909-455f-abdb-485a8576e43e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.762245] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3e2acf5-3909-455f-abdb-485a8576e43e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.762625] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3e2acf5-3909-455f-abdb-485a8576e43e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.762718] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3e2acf5-3909-455f-abdb-485a8576e43e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.286746] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.286996] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.286996] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.287187] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.287279] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.287376] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3e2acf5-3909-455f-abdb-485a8576e43e already deleted. [ 641.287457] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3e2acf5-3909-455f-abdb-485a8576e43e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.763711] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 645.763711] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 650.764564] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 650.764564] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 655.766077] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 655.766469] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 658.899058] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.899462] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.899462] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.899550] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.899694] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.401698] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.903992] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.406233] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 660.406402] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 660.767256] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 660.767446] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 661.115906] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.116304] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.116304] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.116376] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.130707] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 661.131689] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.132813] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 661.150770] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.150985] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.151039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.151232] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.151315] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.151420] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 661.151491] env[70520]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70520) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 661.151559] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 661.171200] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.171391] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.171434] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.171609] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.171750] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.171879] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 661.194201] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.194411] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.194411] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.194590] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.194688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.194791] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 661.213787] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.214035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.214035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.214246] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.214345] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.214458] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 661.214527] env[70520]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=70520) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 661.214593] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 661.234804] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.235055] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.235055] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.235224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.235301] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.235409] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 661.235481] env[70520]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70520) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 661.235548] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 661.257433] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.257687] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.257687] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.257809] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.257911] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.258070] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 661.258154] env[70520]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70520) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 661.258154] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 661.258253] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 661.258285] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 661.258345] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 661.258393] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 661.258646] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 661.258700] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 661.258769] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 661.279496] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.279680] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.279680] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.279869] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.279969] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.280104] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 661.298350] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.298530] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.298530] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.298747] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.298826] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.337768] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.769018] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 665.769300] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 667.571676] env[70520]: INFO networking_nsxv3.common.synchronization [None req-908dd64c-e0d7-4017-a9a7-1906e4344137 None None] Enqueued Resource ID: 1a6fd5c4-7256-4a2a-912d-7a842546dcdd with Priority: HIGHEST for action port [ 667.572818] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a6fd5c4-7256-4a2a-912d-7a842546dcdd with Priority: HIGHEST for action port [ 667.573474] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a6fd5c4-7256-4a2a-912d-7a842546dcdd taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.573627] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a6fd5c4-7256-4a2a-912d-7a842546dcdd" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.574075] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a6fd5c4-7256-4a2a-912d-7a842546dcdd" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.574075] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a6fd5c4-7256-4a2a-912d-7a842546dcdd" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.574075] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a6fd5c4-7256-4a2a-912d-7a842546dcdd',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.076923] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a6fd5c4-7256-4a2a-912d-7a842546dcdd [ 668.077309] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.077632] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.077632] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.077934] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.078264] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.078264] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a6fd5c4-7256-4a2a-912d-7a842546dcdd already deleted. [ 668.078432] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a6fd5c4-7256-4a2a-912d-7a842546dcdd" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.503794] env[70520]: INFO networking_nsxv3.common.synchronization [None req-64046750-5711-4817-8f2e-ee95d4612979 None None] Enqueued Resource ID: 54160dac-6574-4c93-b96c-f6b334571c1b with Priority: HIGHEST for action port [ 669.505701] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54160dac-6574-4c93-b96c-f6b334571c1b with Priority: HIGHEST for action port [ 669.505701] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-54160dac-6574-4c93-b96c-f6b334571c1b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.505701] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54160dac-6574-4c93-b96c-f6b334571c1b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.505701] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54160dac-6574-4c93-b96c-f6b334571c1b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.505701] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54160dac-6574-4c93-b96c-f6b334571c1b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.506353] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54160dac-6574-4c93-b96c-f6b334571c1b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.764259] env[70520]: INFO networking_nsxv3.common.synchronization [None req-e93d986e-0334-4fad-a236-06ec57b0dea2 None None] Enqueued Resource ID: 0ffd73a8-314f-44be-ae38-533627511a30 with Priority: HIGHEST for action port [ 669.764531] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ffd73a8-314f-44be-ae38-533627511a30 with Priority: HIGHEST for action port [ 669.765119] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ffd73a8-314f-44be-ae38-533627511a30 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.765250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ffd73a8-314f-44be-ae38-533627511a30" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.765320] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ffd73a8-314f-44be-ae38-533627511a30" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.765650] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ffd73a8-314f-44be-ae38-533627511a30" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.765650] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ffd73a8-314f-44be-ae38-533627511a30',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.009497] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 54160dac-6574-4c93-b96c-f6b334571c1b [ 670.010516] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.010516] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.010516] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.010516] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.010516] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.010516] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:54160dac-6574-4c93-b96c-f6b334571c1b already deleted. [ 670.011679] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54160dac-6574-4c93-b96c-f6b334571c1b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.270902] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ffd73a8-314f-44be-ae38-533627511a30 [ 670.271349] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.272204] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.272438] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.272762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.272967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.273190] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ffd73a8-314f-44be-ae38-533627511a30 already deleted. [ 670.273380] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ffd73a8-314f-44be-ae38-533627511a30" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.746192] env[70520]: INFO networking_nsxv3.common.synchronization [None req-e63889ff-a58b-41b2-aee3-c5dc47e82e21 None None] Enqueued Resource ID: 47bb1a4b-a9e3-4c5c-93aa-91d6473a7805 with Priority: HIGHEST for action port [ 670.746859] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47bb1a4b-a9e3-4c5c-93aa-91d6473a7805 with Priority: HIGHEST for action port [ 670.747494] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-47bb1a4b-a9e3-4c5c-93aa-91d6473a7805 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.747946] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47bb1a4b-a9e3-4c5c-93aa-91d6473a7805" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.748060] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47bb1a4b-a9e3-4c5c-93aa-91d6473a7805" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.748328] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47bb1a4b-a9e3-4c5c-93aa-91d6473a7805" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.748427] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47bb1a4b-a9e3-4c5c-93aa-91d6473a7805',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.253400] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 47bb1a4b-a9e3-4c5c-93aa-91d6473a7805 [ 671.253644] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.254019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.254019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.254110] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.254186] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.254288] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:47bb1a4b-a9e3-4c5c-93aa-91d6473a7805 already deleted. [ 671.254366] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47bb1a4b-a9e3-4c5c-93aa-91d6473a7805" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.336862] env[70520]: INFO networking_nsxv3.common.synchronization [None req-9b67e5be-6399-4195-ba77-eadeaa2e848b None None] Enqueued Resource ID: d49c44f9-25b0-4395-8100-d96e16d472f5 with Priority: HIGHEST for action port [ 671.336862] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d49c44f9-25b0-4395-8100-d96e16d472f5 with Priority: HIGHEST for action port [ 671.337544] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-d49c44f9-25b0-4395-8100-d96e16d472f5 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.337867] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d49c44f9-25b0-4395-8100-d96e16d472f5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.338053] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d49c44f9-25b0-4395-8100-d96e16d472f5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.338461] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d49c44f9-25b0-4395-8100-d96e16d472f5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.338647] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d49c44f9-25b0-4395-8100-d96e16d472f5',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.841353] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d49c44f9-25b0-4395-8100-d96e16d472f5 [ 671.844114] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.844114] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.844114] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.844114] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.844114] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.844114] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d49c44f9-25b0-4395-8100-d96e16d472f5 already deleted. [ 671.844114] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d49c44f9-25b0-4395-8100-d96e16d472f5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.140349] env[70520]: INFO networking_nsxv3.common.synchronization [None req-c07acc4d-a916-4d64-92c6-33006b88b064 None None] Enqueued Resource ID: 12a568a5-476f-43c9-ac28-820ed11e1e07 with Priority: HIGHEST for action port [ 672.141034] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a568a5-476f-43c9-ac28-820ed11e1e07 with Priority: HIGHEST for action port [ 672.141425] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-12a568a5-476f-43c9-ac28-820ed11e1e07 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.141539] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12a568a5-476f-43c9-ac28-820ed11e1e07" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.141611] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12a568a5-476f-43c9-ac28-820ed11e1e07" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.141865] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12a568a5-476f-43c9-ac28-820ed11e1e07" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.141951] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12a568a5-476f-43c9-ac28-820ed11e1e07',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.628311] env[70520]: INFO networking_nsxv3.common.synchronization [None req-0ef179be-7269-4b8e-acbd-20ab0ff810d9 None None] Enqueued Resource ID: 11875209-2372-494b-abf7-f6e1bc33785f with Priority: HIGHEST for action port [ 672.630047] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11875209-2372-494b-abf7-f6e1bc33785f with Priority: HIGHEST for action port [ 672.630047] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-11875209-2372-494b-abf7-f6e1bc33785f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.630047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11875209-2372-494b-abf7-f6e1bc33785f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.630047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11875209-2372-494b-abf7-f6e1bc33785f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.630406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11875209-2372-494b-abf7-f6e1bc33785f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.630477] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11875209-2372-494b-abf7-f6e1bc33785f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.644674] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12a568a5-476f-43c9-ac28-820ed11e1e07 [ 672.644915] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.645097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.645179] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.645380] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.645467] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.645556] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12a568a5-476f-43c9-ac28-820ed11e1e07 already deleted. [ 672.645631] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12a568a5-476f-43c9-ac28-820ed11e1e07" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.136944] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 11875209-2372-494b-abf7-f6e1bc33785f [ 673.136944] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.136944] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.136944] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.136944] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.136944] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.136944] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:11875209-2372-494b-abf7-f6e1bc33785f already deleted. [ 673.136944] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11875209-2372-494b-abf7-f6e1bc33785f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.569199] env[70520]: INFO networking_nsxv3.common.synchronization [None req-a4f2e1cd-b4e4-4001-bd5b-ffabf850d618 None None] Enqueued Resource ID: 8335039a-1206-4d56-81a5-8021907727e4 with Priority: HIGHEST for action port [ 673.569698] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8335039a-1206-4d56-81a5-8021907727e4 with Priority: HIGHEST for action port [ 673.570073] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-8335039a-1206-4d56-81a5-8021907727e4 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.570144] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8335039a-1206-4d56-81a5-8021907727e4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.570216] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8335039a-1206-4d56-81a5-8021907727e4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.570462] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8335039a-1206-4d56-81a5-8021907727e4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.570546] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8335039a-1206-4d56-81a5-8021907727e4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.020070] env[70520]: INFO networking_nsxv3.common.synchronization [None req-351d534c-c803-4473-9f4a-5d65712ff982 None None] Enqueued Resource ID: abf326e5-7ddb-46a8-8b83-94a537313c67 with Priority: HIGHEST for action port [ 674.020070] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf326e5-7ddb-46a8-8b83-94a537313c67 with Priority: HIGHEST for action port [ 674.020070] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-abf326e5-7ddb-46a8-8b83-94a537313c67 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.020070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abf326e5-7ddb-46a8-8b83-94a537313c67" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.020070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abf326e5-7ddb-46a8-8b83-94a537313c67" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.020354] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abf326e5-7ddb-46a8-8b83-94a537313c67" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.020384] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abf326e5-7ddb-46a8-8b83-94a537313c67',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.073805] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8335039a-1206-4d56-81a5-8021907727e4 [ 674.074257] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.074394] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.074462] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.075163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.075275] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.075403] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8335039a-1206-4d56-81a5-8021907727e4 already deleted. [ 674.075503] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8335039a-1206-4d56-81a5-8021907727e4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.210386] env[70520]: INFO networking_nsxv3.common.synchronization [None req-5ad2ebc3-c820-43fb-b2b8-14e03b63fd6c None None] Enqueued Resource ID: 32ed9fc8-829b-4996-b368-fe20b5108c75 with Priority: HIGHEST for action port [ 674.210386] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ed9fc8-829b-4996-b368-fe20b5108c75 with Priority: HIGHEST for action port [ 674.210386] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-32ed9fc8-829b-4996-b368-fe20b5108c75 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.210386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32ed9fc8-829b-4996-b368-fe20b5108c75" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.210386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32ed9fc8-829b-4996-b368-fe20b5108c75" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.210386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32ed9fc8-829b-4996-b368-fe20b5108c75" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.210386] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32ed9fc8-829b-4996-b368-fe20b5108c75',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.303346] env[70520]: INFO networking_nsxv3.common.synchronization [None req-7ae4c765-db65-4628-9020-402452eb015f None None] Enqueued Resource ID: e48f1977-c779-40df-b656-abe32c3f3cce with Priority: HIGHEST for action port [ 674.303461] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e48f1977-c779-40df-b656-abe32c3f3cce with Priority: HIGHEST for action port [ 674.308105] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-e48f1977-c779-40df-b656-abe32c3f3cce taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.308288] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e48f1977-c779-40df-b656-abe32c3f3cce" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.308363] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e48f1977-c779-40df-b656-abe32c3f3cce" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.308723] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e48f1977-c779-40df-b656-abe32c3f3cce" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.308723] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e48f1977-c779-40df-b656-abe32c3f3cce',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.524142] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port abf326e5-7ddb-46a8-8b83-94a537313c67 [ 674.524399] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.524536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.524605] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.525135] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.525135] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.525135] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:abf326e5-7ddb-46a8-8b83-94a537313c67 already deleted. [ 674.525135] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abf326e5-7ddb-46a8-8b83-94a537313c67" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.714699] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 32ed9fc8-829b-4996-b368-fe20b5108c75 [ 674.714954] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.715298] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.715298] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.715846] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.715846] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.715846] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:32ed9fc8-829b-4996-b368-fe20b5108c75 already deleted. [ 674.715846] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32ed9fc8-829b-4996-b368-fe20b5108c75" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.811340] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e48f1977-c779-40df-b656-abe32c3f3cce [ 674.811572] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.811799] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.811799] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.812313] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.812313] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.812575] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e48f1977-c779-40df-b656-abe32c3f3cce already deleted. [ 674.812575] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e48f1977-c779-40df-b656-abe32c3f3cce" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.640249] env[70520]: INFO networking_nsxv3.common.synchronization [None req-eab8f040-a889-44f8-baf2-d84e3251f360 None None] Enqueued Resource ID: 7e96c4f7-ade2-43e2-9db0-6f1fc3fbd41c with Priority: HIGHEST for action port [ 675.640807] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e96c4f7-ade2-43e2-9db0-6f1fc3fbd41c with Priority: HIGHEST for action port [ 675.641119] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e96c4f7-ade2-43e2-9db0-6f1fc3fbd41c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.641238] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e96c4f7-ade2-43e2-9db0-6f1fc3fbd41c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.641303] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e96c4f7-ade2-43e2-9db0-6f1fc3fbd41c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.641563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e96c4f7-ade2-43e2-9db0-6f1fc3fbd41c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.641643] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e96c4f7-ade2-43e2-9db0-6f1fc3fbd41c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.143487] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e96c4f7-ade2-43e2-9db0-6f1fc3fbd41c [ 676.143773] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.144252] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.144252] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.144460] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.144531] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.144594] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e96c4f7-ade2-43e2-9db0-6f1fc3fbd41c already deleted. [ 676.144670] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e96c4f7-ade2-43e2-9db0-6f1fc3fbd41c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.394021] env[70520]: INFO networking_nsxv3.common.synchronization [None req-92a40dca-dc68-4c75-96cf-6d1d3023ed9d None None] Enqueued Resource ID: c9d9b5fe-0c6c-421b-8a89-5d33e0c917e2 with Priority: HIGHEST for action port [ 677.394021] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9d9b5fe-0c6c-421b-8a89-5d33e0c917e2 with Priority: HIGHEST for action port [ 677.394021] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9d9b5fe-0c6c-421b-8a89-5d33e0c917e2 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.394021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9d9b5fe-0c6c-421b-8a89-5d33e0c917e2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.394021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9d9b5fe-0c6c-421b-8a89-5d33e0c917e2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.394532] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9d9b5fe-0c6c-421b-8a89-5d33e0c917e2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.394532] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9d9b5fe-0c6c-421b-8a89-5d33e0c917e2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.808711] env[70520]: INFO networking_nsxv3.common.synchronization [None req-4109da1f-a491-4378-9e46-5386623dfba1 None None] Enqueued Resource ID: 2ef74c1f-c9c1-4369-9ae3-185f637cd820 with Priority: HIGHEST for action port [ 677.809032] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ef74c1f-c9c1-4369-9ae3-185f637cd820 with Priority: HIGHEST for action port [ 677.809587] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ef74c1f-c9c1-4369-9ae3-185f637cd820 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.809702] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ef74c1f-c9c1-4369-9ae3-185f637cd820" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.809790] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ef74c1f-c9c1-4369-9ae3-185f637cd820" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.810945] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ef74c1f-c9c1-4369-9ae3-185f637cd820" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.811096] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ef74c1f-c9c1-4369-9ae3-185f637cd820',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.898920] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c9d9b5fe-0c6c-421b-8a89-5d33e0c917e2 [ 677.899256] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.899395] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.899462] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.899666] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.899779] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.899838] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c9d9b5fe-0c6c-421b-8a89-5d33e0c917e2 already deleted. [ 677.901064] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9d9b5fe-0c6c-421b-8a89-5d33e0c917e2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.089958] env[70520]: INFO networking_nsxv3.common.synchronization [None req-67da3c57-78f6-484d-b40c-441361184b9a None None] Enqueued Resource ID: d9835b9b-df8c-4699-90a7-18537e2fa62a with Priority: HIGHEST for action port [ 678.089958] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9835b9b-df8c-4699-90a7-18537e2fa62a with Priority: HIGHEST for action port [ 678.089958] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9835b9b-df8c-4699-90a7-18537e2fa62a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.089958] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9835b9b-df8c-4699-90a7-18537e2fa62a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.089958] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9835b9b-df8c-4699-90a7-18537e2fa62a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.089958] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9835b9b-df8c-4699-90a7-18537e2fa62a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.089958] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9835b9b-df8c-4699-90a7-18537e2fa62a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.314528] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ef74c1f-c9c1-4369-9ae3-185f637cd820 [ 678.314528] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.314528] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.314528] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.314724] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.318026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.318026] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ef74c1f-c9c1-4369-9ae3-185f637cd820 already deleted. [ 678.318026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ef74c1f-c9c1-4369-9ae3-185f637cd820" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.596626] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d9835b9b-df8c-4699-90a7-18537e2fa62a [ 678.596626] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.596626] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.596626] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.596626] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.596626] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.596626] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d9835b9b-df8c-4699-90a7-18537e2fa62a already deleted. [ 678.596626] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9835b9b-df8c-4699-90a7-18537e2fa62a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.375656] env[70520]: INFO networking_nsxv3.common.synchronization [None req-d309d548-ae15-4d5d-b27c-6afbdf4db5d1 None None] Enqueued Resource ID: efe12d2a-0890-4a5b-8af1-3805f2b937f2 with Priority: HIGHEST for action port [ 679.375816] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efe12d2a-0890-4a5b-8af1-3805f2b937f2 with Priority: HIGHEST for action port [ 679.376492] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-efe12d2a-0890-4a5b-8af1-3805f2b937f2 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.376492] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-efe12d2a-0890-4a5b-8af1-3805f2b937f2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.376492] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-efe12d2a-0890-4a5b-8af1-3805f2b937f2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.378413] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-efe12d2a-0890-4a5b-8af1-3805f2b937f2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.378413] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efe12d2a-0890-4a5b-8af1-3805f2b937f2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.392698] env[70520]: INFO networking_nsxv3.common.synchronization [None req-206863af-19b6-4d4c-abd2-69350e4cd5bb tempest-VolumesAdminNegativeTest-725810316 tempest-VolumesAdminNegativeTest-725810316-project-member] Enqueued Resource ID: 4686572e-3137-42e1-a568-9db02b6e5e1c with Priority: HIGHEST for action security_group_rules [ 679.393415] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4686572e-3137-42e1-a568-9db02b6e5e1c with Priority: HIGHEST for action security_group_rules [ 679.393733] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4686572e-3137-42e1-a568-9db02b6e5e1c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.393895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.393895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.394185] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.394263] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4686572e-3137-42e1-a568-9db02b6e5e1c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.585807] env[70520]: INFO networking_nsxv3.common.synchronization [None req-d6f2da10-85b0-457d-85cc-4264618fddef tempest-VolumesAdminNegativeTest-725810316 tempest-VolumesAdminNegativeTest-725810316-project-member] Enqueued Resource ID: 4686572e-3137-42e1-a568-9db02b6e5e1c with Priority: HIGHEST for action security_group_rules [ 679.585807] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4686572e-3137-42e1-a568-9db02b6e5e1c with Priority: HIGHEST for action security_group_rules [ 679.586409] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4686572e-3137-42e1-a568-9db02b6e5e1c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.586409] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.635701] env[70520]: INFO networking_nsxv3.common.synchronization [req-fa28ff3c-701e-4035-93d8-666b92c4fc5e req-83d617b2-fdc6-4eca-9145-cf363130bd3f tempest-SecurityGroupRulesTestJSON-1452818246 tempest-SecurityGroupRulesTestJSON-1452818246-project-member] Enqueued Resource ID: 739c48dc-8def-46ac-8a8f-a035b5d54bbc with Priority: HIGHEST for action security_group_rules [ 679.636696] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 739c48dc-8def-46ac-8a8f-a035b5d54bbc with Priority: HIGHEST for action security_group_rules [ 679.637297] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-739c48dc-8def-46ac-8a8f-a035b5d54bbc taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.637421] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-739c48dc-8def-46ac-8a8f-a035b5d54bbc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.637486] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-739c48dc-8def-46ac-8a8f-a035b5d54bbc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.637759] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-739c48dc-8def-46ac-8a8f-a035b5d54bbc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.637838] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('739c48dc-8def-46ac-8a8f-a035b5d54bbc',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.694149] env[70520]: INFO networking_nsxv3.common.synchronization [None req-a50ab470-b79b-480a-8df9-9766ef90ff60 None None] Enqueued Resource ID: ef208e71-3ced-4c25-b158-c5855d6f9599 with Priority: HIGHEST for action port [ 679.694635] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef208e71-3ced-4c25-b158-c5855d6f9599 with Priority: HIGHEST for action port [ 679.694930] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef208e71-3ced-4c25-b158-c5855d6f9599 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.696185] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef208e71-3ced-4c25-b158-c5855d6f9599" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.697347] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef208e71-3ced-4c25-b158-c5855d6f9599" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.697600] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef208e71-3ced-4c25-b158-c5855d6f9599" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.697600] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef208e71-3ced-4c25-b158-c5855d6f9599',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.880842] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port efe12d2a-0890-4a5b-8af1-3805f2b937f2 [ 679.880991] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.881157] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.881257] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.881458] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.882389] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.882389] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:efe12d2a-0890-4a5b-8af1-3805f2b937f2 already deleted. [ 679.882389] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-efe12d2a-0890-4a5b-8af1-3805f2b937f2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.915950] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.917804] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.919307] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.919307] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.919307] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.919307] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4686572e-3137-42e1-a568-9db02b6e5e1c already deleted. [ 679.919307] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.919307] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.919307] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.919307] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4686572e-3137-42e1-a568-9db02b6e5e1c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.159054] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.159202] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.159272] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.159497] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.159590] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.159685] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 739c48dc-8def-46ac-8a8f-a035b5d54bbc already deleted. [ 680.159764] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-739c48dc-8def-46ac-8a8f-a035b5d54bbc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.199902] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef208e71-3ced-4c25-b158-c5855d6f9599 [ 680.200463] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.201269] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.201378] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.201591] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.201680] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.201778] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef208e71-3ced-4c25-b158-c5855d6f9599 already deleted. [ 680.201856] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef208e71-3ced-4c25-b158-c5855d6f9599" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.445229] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.445718] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.445788] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.445996] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.446163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.446223] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4686572e-3137-42e1-a568-9db02b6e5e1c already deleted. [ 680.446315] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.399183] env[70520]: INFO networking_nsxv3.common.synchronization [req-8ef2267d-ac10-495b-b1df-d776ba141c70 req-8303a915-aa3a-48f6-9746-8e72fd0e23ca tempest-InstanceActionsTestJSON-1456976107 tempest-InstanceActionsTestJSON-1456976107-project-member] Enqueued Resource ID: 4e11ed3d-a638-4666-83ac-41d49f4f9874 with Priority: HIGHEST for action security_group_members [ 681.399183] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e11ed3d-a638-4666-83ac-41d49f4f9874 with Priority: HIGHEST for action security_group_members [ 681.399804] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e11ed3d-a638-4666-83ac-41d49f4f9874 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.400125] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.400283] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.400597] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.400843] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.401999] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.401999] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.401999] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.401999] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.401999] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e11ed3d-a638-4666-83ac-41d49f4f9874',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.689352] env[70520]: INFO networking_nsxv3.common.synchronization [None req-0d195a2e-1a81-4ff5-89ab-aadfdd792a2e None None] Enqueued Resource ID: ebaa03a0-1406-4d97-bde8-3188aeb311b1 with Priority: HIGHEST for action port [ 681.690619] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebaa03a0-1406-4d97-bde8-3188aeb311b1 with Priority: HIGHEST for action port [ 681.691245] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebaa03a0-1406-4d97-bde8-3188aeb311b1 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.691753] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebaa03a0-1406-4d97-bde8-3188aeb311b1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.691753] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebaa03a0-1406-4d97-bde8-3188aeb311b1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.692018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebaa03a0-1406-4d97-bde8-3188aeb311b1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.692192] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebaa03a0-1406-4d97-bde8-3188aeb311b1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.906494] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.906494] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.906671] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.906901] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.906901] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.907047] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.907159] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.907224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.907560] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.907560] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.907560] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e11ed3d-a638-4666-83ac-41d49f4f9874 already deleted. [ 681.907723] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.197234] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ebaa03a0-1406-4d97-bde8-3188aeb311b1 [ 682.199055] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.199055] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.199055] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.199055] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.199055] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.199055] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ebaa03a0-1406-4d97-bde8-3188aeb311b1 already deleted. [ 682.199055] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebaa03a0-1406-4d97-bde8-3188aeb311b1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.007206] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-800 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.007596] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-800" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.007666] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-800" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.008076] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-800" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.008389] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.008587] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.008735] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.009084] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.009701] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.009701] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 683.009701] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 683.010168] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 683.010168] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 683.010309] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 683.010506] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 683.010713] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 683.033214] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 683.033214] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 683.033214] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 683.033523] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-800" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.034175] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-aedffa36-533b-4c42-8013-76539a30db62 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.034960] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-aedffa36-533b-4c42-8013-76539a30db62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.034960] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-aedffa36-533b-4c42-8013-76539a30db62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.035408] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-aedffa36-533b-4c42-8013-76539a30db62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.035619] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aedffa36-533b-4c42-8013-76539a30db62',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.068172] env[70520]: INFO networking_nsxv3.common.synchronization [req-aa0d3b6e-d378-4284-ace3-3b06bdfc41c1 req-0b74b851-f605-4a50-b24e-5d58d0ef754e tempest-SecurityGroupRulesTestJSON-1452818246 tempest-SecurityGroupRulesTestJSON-1452818246-project-member] Enqueued Resource ID: 41505653-fe38-4c90-b5fd-7ed23a10f87c with Priority: HIGHEST for action security_group_rules [ 683.071825] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41505653-fe38-4c90-b5fd-7ed23a10f87c with Priority: HIGHEST for action security_group_rules [ 683.071825] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41505653-fe38-4c90-b5fd-7ed23a10f87c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.071825] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41505653-fe38-4c90-b5fd-7ed23a10f87c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.071825] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41505653-fe38-4c90-b5fd-7ed23a10f87c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.071825] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41505653-fe38-4c90-b5fd-7ed23a10f87c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.071825] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41505653-fe38-4c90-b5fd-7ed23a10f87c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.538366] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.538579] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.538699] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.538981] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.539245] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.539335] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port aedffa36-533b-4c42-8013-76539a30db62 not found, creating... [ 683.539542] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.539693] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.539804] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.540020] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.540184] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.540534] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.541156] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.541156] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.541156] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.543323] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.543560] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: aedffa36-533b-4c42-8013-76539a30db62 is going to be created. [ 683.584679] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.584679] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.584991] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.585053] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.585413] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.585546] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-aedffa36-533b-4c42-8013-76539a30db62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.615886] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.615886] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.615886] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.615886] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.615886] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.615886] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41505653-fe38-4c90-b5fd-7ed23a10f87c already deleted. [ 683.615886] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41505653-fe38-4c90-b5fd-7ed23a10f87c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.007316] env[70520]: INFO networking_nsxv3.common.synchronization [req-fb07639d-b9a5-4653-a681-49c324f09daf req-51481d8b-9684-4d2c-b1c4-a05280e3aa8a tempest-ServerDiagnosticsTest-599789744 tempest-ServerDiagnosticsTest-599789744-project-member] Enqueued Resource ID: 65c0ca8f-175d-4fd9-9598-89112bfad470 with Priority: HIGHEST for action security_group_members [ 684.007681] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65c0ca8f-175d-4fd9-9598-89112bfad470 with Priority: HIGHEST for action security_group_members [ 684.007903] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-65c0ca8f-175d-4fd9-9598-89112bfad470 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.008014] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.011264] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.012670] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.012670] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.012670] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.012670] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.012670] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.012670] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.013056] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65c0ca8f-175d-4fd9-9598-89112bfad470',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.043952] env[70520]: INFO networking_nsxv3.common.synchronization [None req-3eb0abcf-34bc-4d97-98e1-f855455c0f8f None None] Enqueued Resource ID: dae4222a-ec73-4bd3-a587-c6d48694adb2 with Priority: HIGHEST for action port [ 684.045242] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dae4222a-ec73-4bd3-a587-c6d48694adb2 with Priority: HIGHEST for action port [ 684.045727] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-dae4222a-ec73-4bd3-a587-c6d48694adb2 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.047179] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dae4222a-ec73-4bd3-a587-c6d48694adb2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.047373] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dae4222a-ec73-4bd3-a587-c6d48694adb2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.047916] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dae4222a-ec73-4bd3-a587-c6d48694adb2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.048191] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dae4222a-ec73-4bd3-a587-c6d48694adb2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.086393] env[70520]: INFO networking_nsxv3.common.synchronization [None req-0f2536ef-ad6c-477a-8cbc-98bfd7360a88 None None] Enqueued Resource ID: af512a9f-e8cc-4240-a54a-4150c048a883 with Priority: HIGHEST for action port [ 684.086393] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af512a9f-e8cc-4240-a54a-4150c048a883 with Priority: HIGHEST for action port [ 684.086393] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-af512a9f-e8cc-4240-a54a-4150c048a883 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.086393] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af512a9f-e8cc-4240-a54a-4150c048a883" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.086393] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af512a9f-e8cc-4240-a54a-4150c048a883" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.086393] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af512a9f-e8cc-4240-a54a-4150c048a883" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.086393] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af512a9f-e8cc-4240-a54a-4150c048a883',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.515767] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.516563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.516656] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.516858] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.516948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.517173] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.517299] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.517338] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.517490] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.517563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.517645] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65c0ca8f-175d-4fd9-9598-89112bfad470 already deleted. [ 684.517722] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.550942] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dae4222a-ec73-4bd3-a587-c6d48694adb2 [ 684.552851] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.554026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.554026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.554026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.554026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.554026] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dae4222a-ec73-4bd3-a587-c6d48694adb2 already deleted. [ 684.554026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dae4222a-ec73-4bd3-a587-c6d48694adb2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.560296] env[70520]: INFO networking_nsxv3.common.synchronization [None req-a083b6c8-d1f0-4bd2-9780-5effacc55770 None None] Enqueued Resource ID: 0f825ca1-1fa1-4191-ad98-ad3e59f1a270 with Priority: HIGHEST for action port [ 684.560296] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f825ca1-1fa1-4191-ad98-ad3e59f1a270 with Priority: HIGHEST for action port [ 684.560296] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f825ca1-1fa1-4191-ad98-ad3e59f1a270 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.560296] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f825ca1-1fa1-4191-ad98-ad3e59f1a270" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.560296] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f825ca1-1fa1-4191-ad98-ad3e59f1a270" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.560296] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f825ca1-1fa1-4191-ad98-ad3e59f1a270" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.560296] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f825ca1-1fa1-4191-ad98-ad3e59f1a270',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.591675] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af512a9f-e8cc-4240-a54a-4150c048a883 [ 684.592176] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.592176] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.592311] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.592436] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.592528] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.592651] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af512a9f-e8cc-4240-a54a-4150c048a883 already deleted. [ 684.592746] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af512a9f-e8cc-4240-a54a-4150c048a883" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.818339] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-659 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.818339] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.818339] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.818339] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.818339] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.818339] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.818626] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.819250] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.819250] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.819250] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 684.819250] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 684.819531] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 684.819531] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 684.819531] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 684.819609] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 684.819777] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 684.839708] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 684.839927] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 684.840016] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 684.840196] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.840506] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-69cf1cff-d8da-4d4e-8606-c3aefb58deca taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.842744] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-69cf1cff-d8da-4d4e-8606-c3aefb58deca" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.843396] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-69cf1cff-d8da-4d4e-8606-c3aefb58deca" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.845697] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-69cf1cff-d8da-4d4e-8606-c3aefb58deca" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.845697] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69cf1cff-d8da-4d4e-8606-c3aefb58deca',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.847614] env[70520]: INFO networking_nsxv3.common.synchronization [req-8ef2267d-ac10-495b-b1df-d776ba141c70 req-46f2ac63-d755-403e-ae83-f632b49cd920 service nova] Enqueued Resource ID: 4e11ed3d-a638-4666-83ac-41d49f4f9874 with Priority: HIGHEST for action security_group_rules [ 684.847778] env[70520]: INFO networking_nsxv3.common.synchronization [req-8ef2267d-ac10-495b-b1df-d776ba141c70 req-46f2ac63-d755-403e-ae83-f632b49cd920 service nova] Enqueued Resource ID: 4e11ed3d-a638-4666-83ac-41d49f4f9874 with Priority: HIGHEST for action security_group_members [ 684.847917] env[70520]: INFO networking_nsxv3.common.synchronization [req-8ef2267d-ac10-495b-b1df-d776ba141c70 req-46f2ac63-d755-403e-ae83-f632b49cd920 service nova] Enqueued Resource ID: aedffa36-533b-4c42-8013-76539a30db62 with Priority: HIGHEST for action port [ 684.848346] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e11ed3d-a638-4666-83ac-41d49f4f9874 with Priority: HIGHEST for action security_group_rules [ 684.848849] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e11ed3d-a638-4666-83ac-41d49f4f9874 with Priority: HIGHEST for action security_group_members [ 684.848849] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aedffa36-533b-4c42-8013-76539a30db62 with Priority: HIGHEST for action port [ 684.850528] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e11ed3d-a638-4666-83ac-41d49f4f9874 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.850690] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.850758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.851011] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.851139] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e11ed3d-a638-4666-83ac-41d49f4f9874',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.855931] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e11ed3d-a638-4666-83ac-41d49f4f9874 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.855931] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.855931] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.855931] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.855931] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.855931] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.855931] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.856328] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.856328] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.856328] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e11ed3d-a638-4666-83ac-41d49f4f9874',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.859963] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-aedffa36-533b-4c42-8013-76539a30db62 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.859963] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aedffa36-533b-4c42-8013-76539a30db62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.859963] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aedffa36-533b-4c42-8013-76539a30db62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.859963] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aedffa36-533b-4c42-8013-76539a30db62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.859963] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aedffa36-533b-4c42-8013-76539a30db62',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.066680] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f825ca1-1fa1-4191-ad98-ad3e59f1a270 [ 685.066680] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.066680] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.066680] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.066680] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.066680] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.066680] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f825ca1-1fa1-4191-ad98-ad3e59f1a270 already deleted. [ 685.066680] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f825ca1-1fa1-4191-ad98-ad3e59f1a270" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.349780] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.350284] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.350465] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.350746] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.350999] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.351082] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 69cf1cff-d8da-4d4e-8606-c3aefb58deca not found, creating... [ 685.351324] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.351495] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.351621] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.351843] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.351974] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.352327] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.352681] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.352681] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.352923] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.352923] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.356368] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 69cf1cff-d8da-4d4e-8606-c3aefb58deca is going to be created. [ 685.356368] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e11ed3d-a638-4666-83ac-41d49f4f9874 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.356368] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.359779] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e11ed3d-a638-4666-83ac-41d49f4f9874',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.368556] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aedffa36-533b-4c42-8013-76539a30db62 with status ACTIVE [ 685.368793] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.368921] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.369022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.369209] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.369297] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.369488] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.369578] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.369626] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.369820] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.369884] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.370051] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.370137] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.370181] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.370293] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.370365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.370447] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aedffa36-533b-4c42-8013-76539a30db62 is going to be updated. [ 685.375295] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.375689] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.375689] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.376012] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.376093] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.376277] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-69cf1cff-d8da-4d4e-8606-c3aefb58deca" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.396309] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.396614] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.396614] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.396865] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.397015] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.397243] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aedffa36-533b-4c42-8013-76539a30db62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.589312] env[70520]: INFO networking_nsxv3.common.synchronization [req-a0fc81c5-f041-4c30-a69e-53762c111f3d req-6a52056d-ee24-4ed5-bdf0-67af7ba7c940 tempest-ServerDiskConfigTestJSON-984450191 tempest-ServerDiskConfigTestJSON-984450191-project-member] Enqueued Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 685.589312] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 685.589312] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.589312] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.589312] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.593873] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.593873] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.593873] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.593873] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.593873] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.593873] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.593873] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.864163] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e11ed3d-a638-4666-83ac-41d49f4f9874',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.000194] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-265 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.000194] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-265" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.000194] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-265" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.000194] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-265" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.000194] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.004924] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.004924] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.004924] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.004924] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.004924] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 686.004924] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 686.004924] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 686.004924] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 686.004924] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 686.004924] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 686.004924] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 686.022817] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 686.025102] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 686.025412] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 686.025693] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-265" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.026229] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-f14dbd6a-6bc8-4986-9467-38d9e870c536 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.026622] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-f14dbd6a-6bc8-4986-9467-38d9e870c536" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.026895] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-f14dbd6a-6bc8-4986-9467-38d9e870c536" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.028636] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-f14dbd6a-6bc8-4986-9467-38d9e870c536" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.028636] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f14dbd6a-6bc8-4986-9467-38d9e870c536',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.097400] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.097893] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.097893] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.097893] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.098062] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.098107] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.098205] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.098258] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.098401] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.098493] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.098568] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 already deleted. [ 686.098624] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.328809] env[70520]: INFO networking_nsxv3.common.synchronization [None req-1679e83c-0d0e-4eda-8d35-87204f186148 tempest-VolumesAssistedSnapshotsTest-545368338 tempest-VolumesAssistedSnapshotsTest-545368338-project-member] Enqueued Resource ID: e2732d4c-390c-4309-8596-f408bd1b4ecf with Priority: HIGHEST for action security_group_rules [ 686.328809] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2732d4c-390c-4309-8596-f408bd1b4ecf with Priority: HIGHEST for action security_group_rules [ 686.328809] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2732d4c-390c-4309-8596-f408bd1b4ecf taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.328809] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.328809] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.328809] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.328809] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2732d4c-390c-4309-8596-f408bd1b4ecf',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.367838] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.368075] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.368075] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.368958] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.368958] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.368958] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e11ed3d-a638-4666-83ac-41d49f4f9874 is going to be created. [ 686.466945] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.467743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.467743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.467743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.467743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.488056] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e11ed3d-a638-4666-83ac-41d49f4f9874 in Status: UNINITIALIZED for 2s [ 686.530754] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.531024] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.532461] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.532461] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.532461] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.532760] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port f14dbd6a-6bc8-4986-9467-38d9e870c536 not found, creating... [ 686.533269] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.533988] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.534259] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.534692] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.534802] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.536387] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.536829] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.536829] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.537238] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.537457] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.537668] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: f14dbd6a-6bc8-4986-9467-38d9e870c536 is going to be created. [ 686.569593] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.572027] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.572027] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.572027] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.572027] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.572027] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-f14dbd6a-6bc8-4986-9467-38d9e870c536" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.590258] env[70520]: INFO networking_nsxv3.common.synchronization [None req-23adca8c-043a-4bcb-8b5d-22668dc32f9a tempest-VolumesAssistedSnapshotsTest-545368338 tempest-VolumesAssistedSnapshotsTest-545368338-project-member] Enqueued Resource ID: e2732d4c-390c-4309-8596-f408bd1b4ecf with Priority: HIGHEST for action security_group_rules [ 686.590854] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2732d4c-390c-4309-8596-f408bd1b4ecf with Priority: HIGHEST for action security_group_rules [ 686.591228] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2732d4c-390c-4309-8596-f408bd1b4ecf taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.591344] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.641903] env[70520]: INFO networking_nsxv3.common.synchronization [req-fb07639d-b9a5-4653-a681-49c324f09daf req-9c9557b8-6621-42f3-a4d8-0cd92449fb1c service nova] Enqueued Resource ID: 65c0ca8f-175d-4fd9-9598-89112bfad470 with Priority: HIGHEST for action security_group_rules [ 686.641903] env[70520]: INFO networking_nsxv3.common.synchronization [req-fb07639d-b9a5-4653-a681-49c324f09daf req-9c9557b8-6621-42f3-a4d8-0cd92449fb1c service nova] Enqueued Resource ID: 65c0ca8f-175d-4fd9-9598-89112bfad470 with Priority: HIGHEST for action security_group_members [ 686.641903] env[70520]: INFO networking_nsxv3.common.synchronization [req-fb07639d-b9a5-4653-a681-49c324f09daf req-9c9557b8-6621-42f3-a4d8-0cd92449fb1c service nova] Enqueued Resource ID: 69cf1cff-d8da-4d4e-8606-c3aefb58deca with Priority: HIGHEST for action port [ 686.642549] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65c0ca8f-175d-4fd9-9598-89112bfad470 with Priority: HIGHEST for action security_group_rules [ 686.642549] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65c0ca8f-175d-4fd9-9598-89112bfad470 with Priority: HIGHEST for action security_group_members [ 686.643806] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69cf1cff-d8da-4d4e-8606-c3aefb58deca with Priority: HIGHEST for action port [ 686.643806] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65c0ca8f-175d-4fd9-9598-89112bfad470 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.643806] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.643806] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.643806] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.643806] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65c0ca8f-175d-4fd9-9598-89112bfad470',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.644580] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-65c0ca8f-175d-4fd9-9598-89112bfad470 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.644697] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.644762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.644995] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.645231] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.645325] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.645586] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.645586] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.646317] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.646317] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65c0ca8f-175d-4fd9-9598-89112bfad470',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.651105] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-69cf1cff-d8da-4d4e-8606-c3aefb58deca taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.651264] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69cf1cff-d8da-4d4e-8606-c3aefb58deca" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.651339] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69cf1cff-d8da-4d4e-8606-c3aefb58deca" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.651565] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69cf1cff-d8da-4d4e-8606-c3aefb58deca" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.651662] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69cf1cff-d8da-4d4e-8606-c3aefb58deca',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.773880] env[70520]: INFO networking_nsxv3.common.synchronization [None req-44079d01-09dc-477f-8412-f709544da59e None None] Enqueued Resource ID: 20bd68d9-2da7-4fd9-bbfa-e34d300d86d3 with Priority: HIGHEST for action port [ 686.774554] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20bd68d9-2da7-4fd9-bbfa-e34d300d86d3 with Priority: HIGHEST for action port [ 686.774801] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-20bd68d9-2da7-4fd9-bbfa-e34d300d86d3 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.774924] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20bd68d9-2da7-4fd9-bbfa-e34d300d86d3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.775025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20bd68d9-2da7-4fd9-bbfa-e34d300d86d3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.775576] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20bd68d9-2da7-4fd9-bbfa-e34d300d86d3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.778193] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20bd68d9-2da7-4fd9-bbfa-e34d300d86d3',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.856751] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.856751] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.856751] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.856899] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.856986] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.857141] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2732d4c-390c-4309-8596-f408bd1b4ecf already deleted. [ 686.857193] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.857320] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.858055] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.858055] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2732d4c-390c-4309-8596-f408bd1b4ecf',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.988363] env[70520]: INFO networking_nsxv3.common.synchronization [req-fe0b4e10-9b26-493e-b719-5de102db3477 req-79619ba3-45da-4e1e-bca8-1f9f848e0930 tempest-SecurityGroupRulesTestJSON-1452818246 tempest-SecurityGroupRulesTestJSON-1452818246-project-member] Enqueued Resource ID: 66ee54ee-1222-4bbe-8528-5a0f511e3d0f with Priority: HIGHEST for action security_group_rules [ 686.989073] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ee54ee-1222-4bbe-8528-5a0f511e3d0f with Priority: HIGHEST for action security_group_rules [ 686.989184] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66ee54ee-1222-4bbe-8528-5a0f511e3d0f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.989476] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66ee54ee-1222-4bbe-8528-5a0f511e3d0f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.989476] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66ee54ee-1222-4bbe-8528-5a0f511e3d0f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.989661] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66ee54ee-1222-4bbe-8528-5a0f511e3d0f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.989735] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66ee54ee-1222-4bbe-8528-5a0f511e3d0f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.157856] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-65c0ca8f-175d-4fd9-9598-89112bfad470 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.158169] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.162863] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65c0ca8f-175d-4fd9-9598-89112bfad470',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.168236] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 69cf1cff-d8da-4d4e-8606-c3aefb58deca with status ACTIVE [ 687.168636] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.168695] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.168928] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.169225] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.169287] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.172333] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.172333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.172333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.172333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.172333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.172333] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.172333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.172333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.172333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.172333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.172333] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 69cf1cff-d8da-4d4e-8606-c3aefb58deca is going to be updated. [ 687.203689] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.203883] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.204128] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.204240] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.204930] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.205444] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69cf1cff-d8da-4d4e-8606-c3aefb58deca" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.285186] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 20bd68d9-2da7-4fd9-bbfa-e34d300d86d3 [ 687.285186] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.285186] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.285186] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.285186] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.285472] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.285472] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:20bd68d9-2da7-4fd9-bbfa-e34d300d86d3 already deleted. [ 687.285664] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20bd68d9-2da7-4fd9-bbfa-e34d300d86d3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.389725] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.389959] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.389959] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.390184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.390302] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.390389] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2732d4c-390c-4309-8596-f408bd1b4ecf already deleted. [ 687.390468] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.512013] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.512332] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.512332] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.512496] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.512592] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.512687] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66ee54ee-1222-4bbe-8528-5a0f511e3d0f already deleted. [ 687.512769] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66ee54ee-1222-4bbe-8528-5a0f511e3d0f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.663148] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65c0ca8f-175d-4fd9-9598-89112bfad470',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.673177] env[70520]: INFO networking_nsxv3.common.synchronization [req-a0fc81c5-f041-4c30-a69e-53762c111f3d req-3c0ef63c-248c-476a-aa43-8083e6fcbd3a service nova] Enqueued Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_rules [ 687.673177] env[70520]: INFO networking_nsxv3.common.synchronization [req-a0fc81c5-f041-4c30-a69e-53762c111f3d req-3c0ef63c-248c-476a-aa43-8083e6fcbd3a service nova] Enqueued Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 687.673248] env[70520]: INFO networking_nsxv3.common.synchronization [req-a0fc81c5-f041-4c30-a69e-53762c111f3d req-3c0ef63c-248c-476a-aa43-8083e6fcbd3a service nova] Enqueued Resource ID: f14dbd6a-6bc8-4986-9467-38d9e870c536 with Priority: HIGHEST for action port [ 687.673414] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_rules [ 687.673536] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 687.673641] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f14dbd6a-6bc8-4986-9467-38d9e870c536 with Priority: HIGHEST for action port [ 687.675327] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.680246] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.680246] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.680246] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.680246] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.680246] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.680246] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.680246] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.680246] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.680246] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.680246] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.680246] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.680246] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.680246] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.680246] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.680880] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-f14dbd6a-6bc8-4986-9467-38d9e870c536 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.680941] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f14dbd6a-6bc8-4986-9467-38d9e870c536" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.680976] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f14dbd6a-6bc8-4986-9467-38d9e870c536" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.681119] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f14dbd6a-6bc8-4986-9467-38d9e870c536" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.681194] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f14dbd6a-6bc8-4986-9467-38d9e870c536',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.979314] env[70520]: INFO networking_nsxv3.common.synchronization [None req-2f7b8cdf-b391-491c-9fbc-b783ee9bf0ea None None] Enqueued Resource ID: 8891b35b-1bfb-46e7-9028-9744709bdea3 with Priority: HIGHEST for action port [ 687.981171] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8891b35b-1bfb-46e7-9028-9744709bdea3 with Priority: HIGHEST for action port [ 687.981529] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-8891b35b-1bfb-46e7-9028-9744709bdea3 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.981655] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8891b35b-1bfb-46e7-9028-9744709bdea3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.981919] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8891b35b-1bfb-46e7-9028-9744709bdea3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.982281] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8891b35b-1bfb-46e7-9028-9744709bdea3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.982323] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8891b35b-1bfb-46e7-9028-9744709bdea3',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.033069] env[70520]: INFO networking_nsxv3.common.synchronization [None req-2cbab6f8-7020-4251-919a-f4457304772f None None] Enqueued Resource ID: 7b44e2a1-8711-4117-bc29-cb276105ad7e with Priority: HIGHEST for action port [ 688.033591] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b44e2a1-8711-4117-bc29-cb276105ad7e with Priority: HIGHEST for action port [ 688.034424] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b44e2a1-8711-4117-bc29-cb276105ad7e taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.034547] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b44e2a1-8711-4117-bc29-cb276105ad7e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.034633] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b44e2a1-8711-4117-bc29-cb276105ad7e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.034856] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b44e2a1-8711-4117-bc29-cb276105ad7e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.034938] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b44e2a1-8711-4117-bc29-cb276105ad7e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.168770] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.168770] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.168770] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.168770] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.168770] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.168770] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65c0ca8f-175d-4fd9-9598-89112bfad470 is going to be created. [ 688.186402] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.186402] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.186402] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.186402] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f14dbd6a-6bc8-4986-9467-38d9e870c536 with status ACTIVE [ 688.186402] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.186402] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.186402] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.186402] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.186402] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.186974] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.186974] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.186974] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.186974] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.187131] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.187230] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.187318] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.187376] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.187631] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.187715] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.187799] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f14dbd6a-6bc8-4986-9467-38d9e870c536 is going to be updated. [ 688.201754] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.201754] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.201754] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.201754] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.201754] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.211137] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.211137] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.211137] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.212033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.212033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.212149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f14dbd6a-6bc8-4986-9467-38d9e870c536" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.217047] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65c0ca8f-175d-4fd9-9598-89112bfad470 in Status: UNINITIALIZED for 2s [ 688.237190] env[70520]: INFO networking_nsxv3.common.synchronization [None req-7582d583-bd15-4575-9a0c-89142f0298a6 None None] Enqueued Resource ID: 3a6f859a-9444-4e2c-b769-fa88e500c160 with Priority: HIGHEST for action port [ 688.237190] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a6f859a-9444-4e2c-b769-fa88e500c160 with Priority: HIGHEST for action port [ 688.237445] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a6f859a-9444-4e2c-b769-fa88e500c160 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.237573] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a6f859a-9444-4e2c-b769-fa88e500c160" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.237649] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a6f859a-9444-4e2c-b769-fa88e500c160" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.237868] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a6f859a-9444-4e2c-b769-fa88e500c160" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.237944] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a6f859a-9444-4e2c-b769-fa88e500c160',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.490488] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8891b35b-1bfb-46e7-9028-9744709bdea3 [ 688.490488] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.490488] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.490488] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.490488] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.490488] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.490488] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8891b35b-1bfb-46e7-9028-9744709bdea3 already deleted. [ 688.490488] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8891b35b-1bfb-46e7-9028-9744709bdea3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.501769] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e11ed3d-a638-4666-83ac-41d49f4f9874 in Status: SUCCESS [ 688.501769] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.501769] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.501769] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.501769] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.502530] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.502530] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.502530] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.502530] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.502530] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.502530] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e11ed3d-a638-4666-83ac-41d49f4f9874',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.537532] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7b44e2a1-8711-4117-bc29-cb276105ad7e [ 688.538161] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.538584] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.538704] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.538881] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.538961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.539078] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7b44e2a1-8711-4117-bc29-cb276105ad7e already deleted. [ 688.539159] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b44e2a1-8711-4117-bc29-cb276105ad7e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.686487] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.743616] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a6f859a-9444-4e2c-b769-fa88e500c160 [ 688.743963] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.744305] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.744305] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.744544] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.744631] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.744732] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a6f859a-9444-4e2c-b769-fa88e500c160 already deleted. [ 688.744812] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a6f859a-9444-4e2c-b769-fa88e500c160" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.926767] env[70520]: INFO networking_nsxv3.common.synchronization [req-81be12c8-25ff-422a-a5ca-aa9f6a4bbfdb req-f4da4f96-f6b0-4f1a-890a-c01723e2362b tempest-TenantUsagesTestJSON-1841604470 tempest-TenantUsagesTestJSON-1841604470-project-member] Enqueued Resource ID: e7c44ea9-34f2-45bb-bf52-dd72b3513eda with Priority: HIGHEST for action security_group_members [ 688.931022] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c44ea9-34f2-45bb-bf52-dd72b3513eda with Priority: HIGHEST for action security_group_members [ 688.931022] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.931022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.931022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.931022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.931022] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.931022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.931022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.931022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.931022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.931022] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7c44ea9-34f2-45bb-bf52-dd72b3513eda',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.006130] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e11ed3d-a638-4666-83ac-41d49f4f9874 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.006319] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.006389] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.006757] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.006757] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.006907] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.006907] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.010163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.010163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.010163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.010163] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e11ed3d-a638-4666-83ac-41d49f4f9874 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.010163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.010163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.010163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.010163] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.010163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.010163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.010163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.010163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.010163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.010163] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e11ed3d-a638-4666-83ac-41d49f4f9874',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.190820] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.190820] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.190820] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.190820] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.190820] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.190820] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 is going to be created. [ 689.334293] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.335124] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.335124] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.335124] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.335124] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.352708] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: UNINITIALIZED for 2s [ 689.431608] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.431779] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.431925] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.433314] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.433468] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.433747] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.434083] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.434083] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.434382] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.434459] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.434553] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7c44ea9-34f2-45bb-bf52-dd72b3513eda already deleted. [ 689.434633] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.474386] env[70520]: INFO networking_nsxv3.common.synchronization [None req-2eb40698-2278-4da4-ae74-c6104bcaa920 tempest-ServersWithSpecificFlavorTestJSON-1288943951 tempest-ServersWithSpecificFlavorTestJSON-1288943951-project-member] Enqueued Resource ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee with Priority: HIGHEST for action security_group_rules [ 689.475035] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee with Priority: HIGHEST for action security_group_rules [ 689.475328] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.475480] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.475563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.475758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.475837] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2449c3c4-f89c-449c-97e2-c22d5d72dbee',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.512501] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e11ed3d-a638-4666-83ac-41d49f4f9874: rpc.has_security_group_logging(os_id): False [ 689.535729] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.535968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.536122] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.536913] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.536913] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.536913] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.537175] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.537175] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.537733] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.537875] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.538296] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.538390] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.538493] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.538783] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.538876] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.539176] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.539329] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.539431] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.539675] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.539812] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.539943] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e11ed3d-a638-4666-83ac-41d49f4f9874 is going to be created. [ 689.614844] env[70520]: INFO networking_nsxv3.common.synchronization [None req-2d9d3dcf-1ea0-40cf-af85-dfa023e0222d None None] Enqueued Resource ID: 71e44c5d-0276-4db2-ace4-e0b79781b13a with Priority: HIGHEST for action port [ 689.614844] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71e44c5d-0276-4db2-ace4-e0b79781b13a with Priority: HIGHEST for action port [ 689.614844] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-71e44c5d-0276-4db2-ace4-e0b79781b13a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.614844] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71e44c5d-0276-4db2-ace4-e0b79781b13a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.614844] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71e44c5d-0276-4db2-ace4-e0b79781b13a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.614844] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71e44c5d-0276-4db2-ace4-e0b79781b13a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.614844] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71e44c5d-0276-4db2-ace4-e0b79781b13a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.689683] env[70520]: INFO networking_nsxv3.common.synchronization [None req-4593743c-b367-4a80-94d7-7065cff852e1 tempest-ServersWithSpecificFlavorTestJSON-1288943951 tempest-ServersWithSpecificFlavorTestJSON-1288943951-project-member] Enqueued Resource ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee with Priority: HIGHEST for action security_group_rules [ 689.691539] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.691539] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.691539] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.691539] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.691539] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.692395] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee with Priority: HIGHEST for action security_group_rules [ 689.693517] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.693517] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.703826] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e11ed3d-a638-4666-83ac-41d49f4f9874 in Status: IN_PROGRESS for 2s [ 689.711239] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-659 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.711239] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.711382] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.711836] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.711836] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.712032] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.712727] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.712727] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.712826] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.712989] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 689.713326] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 689.714217] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 689.714363] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 689.714529] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 689.714736] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 689.715192] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 689.744183] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 689.744513] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 689.744702] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 689.744979] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.745402] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-979e2304-ca4c-41ab-a030-d479208df03c taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.745692] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-979e2304-ca4c-41ab-a030-d479208df03c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.745856] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-979e2304-ca4c-41ab-a030-d479208df03c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.746465] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-979e2304-ca4c-41ab-a030-d479208df03c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.748147] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('979e2304-ca4c-41ab-a030-d479208df03c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.006021] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.006021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.006021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.006021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.006021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.006021] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee already deleted. [ 690.006021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.006479] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.006766] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.006766] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2449c3c4-f89c-449c-97e2-c22d5d72dbee',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.117899] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71e44c5d-0276-4db2-ace4-e0b79781b13a [ 690.118059] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.118145] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.118210] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.118431] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.118509] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.118682] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71e44c5d-0276-4db2-ace4-e0b79781b13a already deleted. [ 690.119252] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71e44c5d-0276-4db2-ace4-e0b79781b13a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.232536] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65c0ca8f-175d-4fd9-9598-89112bfad470 in Status: SUCCESS [ 690.232882] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.233000] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.233605] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.235113] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.235521] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.235521] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.235629] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.235678] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.235773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.235864] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('65c0ca8f-175d-4fd9-9598-89112bfad470',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.252914] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.253508] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.253508] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.253716] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.253716] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.253871] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 979e2304-ca4c-41ab-a030-d479208df03c not found, creating... [ 690.254152] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.254350] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.254477] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.254757] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.254898] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.255999] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.255999] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.255999] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.255999] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.255999] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.256348] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 979e2304-ca4c-41ab-a030-d479208df03c is going to be created. [ 690.286581] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.286826] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.286948] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.287272] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.287781] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.288010] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-979e2304-ca4c-41ab-a030-d479208df03c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.535449] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.536011] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.536123] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.536355] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.536447] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.536598] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee already deleted. [ 690.536703] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.743023] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-65c0ca8f-175d-4fd9-9598-89112bfad470 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.743023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.743023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.743023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.743023] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.743023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.743023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.743023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.743023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.743023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.743023] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-65c0ca8f-175d-4fd9-9598-89112bfad470 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.743023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.743023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.743023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.743023] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.743023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.743713] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.743713] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.743713] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.743713] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.743713] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('65c0ca8f-175d-4fd9-9598-89112bfad470',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.137816] env[70520]: INFO networking_nsxv3.common.synchronization [req-1e0cb7b4-df07-48b7-9a39-754e3133ae1c req-8e5eb21e-1e8a-4d06-aa5c-f04e1dbf3c60 tempest-DeleteServersAdminTestJSON-1646148384 tempest-DeleteServersAdminTestJSON-1646148384-project-member] Enqueued Resource ID: e84213b0-a32e-49bf-97aa-67c24de8104c with Priority: HIGHEST for action security_group_members [ 691.138364] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84213b0-a32e-49bf-97aa-67c24de8104c with Priority: HIGHEST for action security_group_members [ 691.138662] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84213b0-a32e-49bf-97aa-67c24de8104c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.138785] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.138838] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.142528] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.142528] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.142528] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.142528] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.142528] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.142528] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.142528] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e84213b0-a32e-49bf-97aa-67c24de8104c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.246434] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 65c0ca8f-175d-4fd9-9598-89112bfad470: rpc.has_security_group_logging(os_id): False [ 691.273890] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.274520] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.274631] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.274904] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.275011] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.275533] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.275653] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.275720] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.275939] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.275977] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.276383] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.276470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.276470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.276698] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.276806] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.276988] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.277302] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.277406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.277874] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.277993] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.278134] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65c0ca8f-175d-4fd9-9598-89112bfad470 is going to be created. [ 691.356218] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.356218] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.356218] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.357243] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.357887] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.374023] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: SUCCESS [ 691.374023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.374023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.374023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.374023] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.374023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.374023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.374023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.374023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.374023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.374023] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.376587] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65c0ca8f-175d-4fd9-9598-89112bfad470 in Status: IN_PROGRESS for 2s [ 691.544079] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-659 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.544327] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.544510] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.544742] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.544996] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.545168] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.545358] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.545642] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.545895] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.545990] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 691.546113] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 691.546220] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 691.546328] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 691.546447] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 691.546550] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 691.546679] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 691.552741] env[70520]: INFO networking_nsxv3.common.synchronization [req-81be12c8-25ff-422a-a5ca-aa9f6a4bbfdb req-10470e78-027f-4fd6-bc6f-cf1f78af056a service nova] Enqueued Resource ID: e7c44ea9-34f2-45bb-bf52-dd72b3513eda with Priority: HIGHEST for action security_group_rules [ 691.552918] env[70520]: INFO networking_nsxv3.common.synchronization [req-81be12c8-25ff-422a-a5ca-aa9f6a4bbfdb req-10470e78-027f-4fd6-bc6f-cf1f78af056a service nova] Enqueued Resource ID: e7c44ea9-34f2-45bb-bf52-dd72b3513eda with Priority: HIGHEST for action security_group_members [ 691.553090] env[70520]: INFO networking_nsxv3.common.synchronization [req-81be12c8-25ff-422a-a5ca-aa9f6a4bbfdb req-10470e78-027f-4fd6-bc6f-cf1f78af056a service nova] Enqueued Resource ID: 979e2304-ca4c-41ab-a030-d479208df03c with Priority: HIGHEST for action port [ 691.553592] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c44ea9-34f2-45bb-bf52-dd72b3513eda with Priority: HIGHEST for action security_group_rules [ 691.553735] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c44ea9-34f2-45bb-bf52-dd72b3513eda with Priority: HIGHEST for action security_group_members [ 691.553833] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 979e2304-ca4c-41ab-a030-d479208df03c with Priority: HIGHEST for action port [ 691.554110] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7c44ea9-34f2-45bb-bf52-dd72b3513eda taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.554249] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.554315] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.554654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.554654] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7c44ea9-34f2-45bb-bf52-dd72b3513eda',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.555601] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.555724] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.555805] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.555984] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.556143] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.556240] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.556310] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.556511] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.556608] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.556724] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7c44ea9-34f2-45bb-bf52-dd72b3513eda',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.557581] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-979e2304-ca4c-41ab-a030-d479208df03c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.557695] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-979e2304-ca4c-41ab-a030-d479208df03c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.557773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-979e2304-ca4c-41ab-a030-d479208df03c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.557906] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-979e2304-ca4c-41ab-a030-d479208df03c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.557978] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('979e2304-ca4c-41ab-a030-d479208df03c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.569218] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 691.569491] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 691.569638] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 691.569815] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.570253] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-932202ca-05c0-43b3-92cc-af20484d598f taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.570466] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-932202ca-05c0-43b3-92cc-af20484d598f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.570607] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-932202ca-05c0-43b3-92cc-af20484d598f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.570931] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-932202ca-05c0-43b3-92cc-af20484d598f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.571414] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('932202ca-05c0-43b3-92cc-af20484d598f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.644917] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.645169] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.645169] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.645390] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.645485] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.645681] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.645780] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.645841] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.646009] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.646087] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.646170] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84213b0-a32e-49bf-97aa-67c24de8104c already deleted. [ 691.646250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.718632] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e11ed3d-a638-4666-83ac-41d49f4f9874 in Status: SUCCESS [ 691.719014] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.876818] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.877133] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.877133] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.877363] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.877536] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.877855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.877855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.877855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.878054] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.878054] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.878145] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.878188] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.878270] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.878528] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.878694] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.878805] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.878878] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.878989] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.879083] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.879320] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.879320] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.060575] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.060754] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.061486] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 979e2304-ca4c-41ab-a030-d479208df03c with status ACTIVE [ 692.061486] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.061486] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.061486] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.061486] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.061773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.061773] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.061773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.061872] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.062909] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.062909] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.062909] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.062909] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.062909] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.062909] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.062909] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.062909] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 979e2304-ca4c-41ab-a030-d479208df03c is going to be updated. [ 692.065472] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7c44ea9-34f2-45bb-bf52-dd72b3513eda',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.075945] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.076235] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.076364] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.076661] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.076872] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.077109] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 932202ca-05c0-43b3-92cc-af20484d598f not found, creating... [ 692.077406] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.077566] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.077682] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.077949] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.078122] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.078455] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.078653] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.079930] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.080220] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.080367] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.080582] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 932202ca-05c0-43b3-92cc-af20484d598f is going to be created. [ 692.087858] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.088051] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.088120] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.088751] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.088751] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.088751] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-979e2304-ca4c-41ab-a030-d479208df03c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.113893] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.114040] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.114107] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.114515] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.115031] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.115031] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-932202ca-05c0-43b3-92cc-af20484d598f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.387415] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a23aa860-12db-4b07-ac46-cf4709db7164: rpc.has_security_group_logging(os_id): False [ 692.408411] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.408411] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.408411] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.408411] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.408411] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.408411] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.408411] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.408411] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.408411] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.408411] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.408411] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.408411] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.408411] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.408411] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.408411] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.409410] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.409707] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.410585] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.410585] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.410585] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.410863] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 is going to be created. [ 692.477023] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.477023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.477023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.477023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.477023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.492971] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: IN_PROGRESS for 2s [ 692.568490] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7c44ea9-34f2-45bb-bf52-dd72b3513eda',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.895708] env[70520]: INFO networking_nsxv3.common.synchronization [req-9d55322b-5e40-4712-be86-799b68c7b6df req-3640b11c-92e7-429f-b32f-66eedd406ff7 tempest-SecurityGroupRulesTestJSON-1452818246 tempest-SecurityGroupRulesTestJSON-1452818246-project-member] Enqueued Resource ID: cfa00d65-29eb-49a8-8bc4-796579803355 with Priority: HIGHEST for action security_group_rules [ 692.897320] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfa00d65-29eb-49a8-8bc4-796579803355 with Priority: HIGHEST for action security_group_rules [ 692.897781] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfa00d65-29eb-49a8-8bc4-796579803355 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.898573] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfa00d65-29eb-49a8-8bc4-796579803355" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.898573] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfa00d65-29eb-49a8-8bc4-796579803355" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.898573] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfa00d65-29eb-49a8-8bc4-796579803355" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.898573] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfa00d65-29eb-49a8-8bc4-796579803355',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.074672] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.074672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.074672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.074672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.074672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.074672] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7c44ea9-34f2-45bb-bf52-dd72b3513eda is going to be created. [ 693.109079] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.109079] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.109079] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.109079] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.109308] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.125040] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7c44ea9-34f2-45bb-bf52-dd72b3513eda in Status: UNINITIALIZED for 2s [ 693.395189] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65c0ca8f-175d-4fd9-9598-89112bfad470 in Status: SUCCESS [ 693.395189] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.414872] env[70520]: INFO networking_nsxv3.common.synchronization [req-22538496-bc1f-4166-941a-c63d80ab0b1b req-38e94e2d-fd4f-43db-a745-6c50e4b6c5ff tempest-FloatingIPsAssociationTestJSON-847223640 tempest-FloatingIPsAssociationTestJSON-847223640-project-member] Enqueued Resource ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 with Priority: HIGHEST for action security_group_members [ 693.416864] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 with Priority: HIGHEST for action security_group_members [ 693.417087] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-22824640-0730-4b9a-a9ef-9014ef216bc4 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.418415] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.418415] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.418415] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.418415] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.418415] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.418415] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.418415] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.418415] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.418415] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22824640-0730-4b9a-a9ef-9014ef216bc4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.438426] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.438566] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.438633] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.438841] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.438917] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.439019] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfa00d65-29eb-49a8-8bc4-796579803355 already deleted. [ 693.439099] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfa00d65-29eb-49a8-8bc4-796579803355" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.457366] env[70520]: INFO networking_nsxv3.common.synchronization [req-1e0cb7b4-df07-48b7-9a39-754e3133ae1c req-b6a0d3f8-5b3e-4e08-b3bc-49d8a4617346 service nova] Enqueued Resource ID: e84213b0-a32e-49bf-97aa-67c24de8104c with Priority: HIGHEST for action security_group_rules [ 693.457366] env[70520]: INFO networking_nsxv3.common.synchronization [req-1e0cb7b4-df07-48b7-9a39-754e3133ae1c req-b6a0d3f8-5b3e-4e08-b3bc-49d8a4617346 service nova] Enqueued Resource ID: e84213b0-a32e-49bf-97aa-67c24de8104c with Priority: HIGHEST for action security_group_members [ 693.457366] env[70520]: INFO networking_nsxv3.common.synchronization [req-1e0cb7b4-df07-48b7-9a39-754e3133ae1c req-b6a0d3f8-5b3e-4e08-b3bc-49d8a4617346 service nova] Enqueued Resource ID: 932202ca-05c0-43b3-92cc-af20484d598f with Priority: HIGHEST for action port [ 693.458742] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84213b0-a32e-49bf-97aa-67c24de8104c with Priority: HIGHEST for action security_group_rules [ 693.458742] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84213b0-a32e-49bf-97aa-67c24de8104c with Priority: HIGHEST for action security_group_members [ 693.458742] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 932202ca-05c0-43b3-92cc-af20484d598f with Priority: HIGHEST for action port [ 693.463859] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e84213b0-a32e-49bf-97aa-67c24de8104c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.463859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.463859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.463859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.463859] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e84213b0-a32e-49bf-97aa-67c24de8104c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.463859] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84213b0-a32e-49bf-97aa-67c24de8104c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.463859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.463859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.463859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.463859] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.463859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.463859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.463859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.463859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.463859] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e84213b0-a32e-49bf-97aa-67c24de8104c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.469546] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-932202ca-05c0-43b3-92cc-af20484d598f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.469971] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-932202ca-05c0-43b3-92cc-af20484d598f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.470365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-932202ca-05c0-43b3-92cc-af20484d598f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.470779] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-932202ca-05c0-43b3-92cc-af20484d598f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.471036] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('932202ca-05c0-43b3-92cc-af20484d598f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.920620] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.920797] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.920835] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.921059] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.921149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.921344] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.921467] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.921512] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.921645] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.921721] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.921805] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 already deleted. [ 693.921883] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.969956] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e84213b0-a32e-49bf-97aa-67c24de8104c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.974730] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84213b0-a32e-49bf-97aa-67c24de8104c taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.974901] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.975351] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 932202ca-05c0-43b3-92cc-af20484d598f with status ACTIVE [ 693.975351] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.975351] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.975351] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.975556] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.975646] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.975817] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.975914] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.975976] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.976392] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.976502] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.976705] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.976918] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.976918] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.977160] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.977160] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.977160] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 932202ca-05c0-43b3-92cc-af20484d598f is going to be updated. [ 694.001040] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.001159] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.001159] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.001335] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.001469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.001635] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-932202ca-05c0-43b3-92cc-af20484d598f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.006164] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-67 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.006164] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-67" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.006164] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-67" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.006164] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-67" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.006164] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.006164] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.006582] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.006582] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.006582] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.007051] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 694.007051] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 694.007051] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 694.007051] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 694.007247] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 694.007284] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 694.008141] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 694.027038] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 694.027214] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 694.027355] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 694.027521] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-67" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.027833] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-ba1ec5c0-406f-462e-83f6-e7049acb555f taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.028014] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-ba1ec5c0-406f-462e-83f6-e7049acb555f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.028130] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-ba1ec5c0-406f-462e-83f6-e7049acb555f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.028469] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-ba1ec5c0-406f-462e-83f6-e7049acb555f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.028604] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba1ec5c0-406f-462e-83f6-e7049acb555f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.474831] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e84213b0-a32e-49bf-97aa-67c24de8104c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.505488] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: SUCCESS [ 694.505770] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.531129] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.531862] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.532027] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.532354] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.532506] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.532662] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port ba1ec5c0-406f-462e-83f6-e7049acb555f not found, creating... [ 694.533572] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.533572] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.533572] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.533572] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.533572] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.533857] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.534022] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.534834] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.535195] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.535504] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.535704] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: ba1ec5c0-406f-462e-83f6-e7049acb555f is going to be created. [ 694.560813] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.561777] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.561982] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.562324] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.562583] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.562861] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-ba1ec5c0-406f-462e-83f6-e7049acb555f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.978015] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.979507] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.979658] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.979886] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.980015] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.980093] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84213b0-a32e-49bf-97aa-67c24de8104c is going to be created. [ 695.009270] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.009557] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.009557] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.009698] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.009855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.033934] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84213b0-a32e-49bf-97aa-67c24de8104c in Status: UNINITIALIZED for 2s [ 695.136027] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7c44ea9-34f2-45bb-bf52-dd72b3513eda in Status: SUCCESS [ 695.138174] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.138174] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.138174] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.138174] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.138174] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.138174] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.138174] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.138174] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.138174] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.138916] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e7c44ea9-34f2-45bb-bf52-dd72b3513eda',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.537971] env[70520]: INFO networking_nsxv3.common.synchronization [req-22538496-bc1f-4166-941a-c63d80ab0b1b req-b879fd54-3b0e-43da-9b89-11cd0b3191a0 service nova] Enqueued Resource ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 with Priority: HIGHEST for action security_group_rules [ 695.537971] env[70520]: INFO networking_nsxv3.common.synchronization [req-22538496-bc1f-4166-941a-c63d80ab0b1b req-b879fd54-3b0e-43da-9b89-11cd0b3191a0 service nova] Enqueued Resource ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 with Priority: HIGHEST for action security_group_members [ 695.537971] env[70520]: INFO networking_nsxv3.common.synchronization [req-22538496-bc1f-4166-941a-c63d80ab0b1b req-b879fd54-3b0e-43da-9b89-11cd0b3191a0 service nova] Enqueued Resource ID: ba1ec5c0-406f-462e-83f6-e7049acb555f with Priority: HIGHEST for action port [ 695.538833] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 with Priority: HIGHEST for action security_group_rules [ 695.538976] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 with Priority: HIGHEST for action security_group_members [ 695.539597] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba1ec5c0-406f-462e-83f6-e7049acb555f with Priority: HIGHEST for action port [ 695.539974] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22824640-0730-4b9a-a9ef-9014ef216bc4 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.540410] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.540556] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.541051] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.541258] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22824640-0730-4b9a-a9ef-9014ef216bc4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.543634] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-22824640-0730-4b9a-a9ef-9014ef216bc4 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.543797] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.543882] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.544168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.544457] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.544519] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.544618] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.544863] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.544897] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.544981] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22824640-0730-4b9a-a9ef-9014ef216bc4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.548408] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba1ec5c0-406f-462e-83f6-e7049acb555f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.548408] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba1ec5c0-406f-462e-83f6-e7049acb555f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.548408] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba1ec5c0-406f-462e-83f6-e7049acb555f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.548408] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba1ec5c0-406f-462e-83f6-e7049acb555f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.548408] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba1ec5c0-406f-462e-83f6-e7049acb555f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.644671] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.644828] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.645859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.645859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.645859] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.645859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.645859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.646254] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.646346] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.647047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.647047] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.647047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.647047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.647047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.647047] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.647274] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.647274] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.647354] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.647354] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.647470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.647524] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e7c44ea9-34f2-45bb-bf52-dd72b3513eda',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.018436] env[70520]: INFO networking_nsxv3.common.synchronization [None req-dffdce6b-dff8-4b8a-9afc-7a80286b7c41 None None] Enqueued Resource ID: f33295b0-1d2b-4766-9487-c97d9b92c65c with Priority: HIGHEST for action port [ 696.018708] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33295b0-1d2b-4766-9487-c97d9b92c65c with Priority: HIGHEST for action port [ 696.019306] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-f33295b0-1d2b-4766-9487-c97d9b92c65c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.019459] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f33295b0-1d2b-4766-9487-c97d9b92c65c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.019527] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f33295b0-1d2b-4766-9487-c97d9b92c65c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.019782] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f33295b0-1d2b-4766-9487-c97d9b92c65c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.019856] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f33295b0-1d2b-4766-9487-c97d9b92c65c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.049148] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-22824640-0730-4b9a-a9ef-9014ef216bc4 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.049277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.049453] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22824640-0730-4b9a-a9ef-9014ef216bc4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.050474] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba1ec5c0-406f-462e-83f6-e7049acb555f with status ACTIVE [ 696.051272] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.051272] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.051272] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.051272] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.051272] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.051272] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.051527] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.051527] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.051581] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.051609] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.051819] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.052198] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.052198] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.056938] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.056938] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.056938] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba1ec5c0-406f-462e-83f6-e7049acb555f is going to be updated. [ 696.081530] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.081677] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.081750] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.082009] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.082183] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.082358] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba1ec5c0-406f-462e-83f6-e7049acb555f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.153398] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e7c44ea9-34f2-45bb-bf52-dd72b3513eda: rpc.has_security_group_logging(os_id): False [ 696.188061] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.188220] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.188220] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.188439] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.188522] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.192762] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.192762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.192762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.192762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.192762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.192762] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.192762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.192762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.192762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.192762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.192762] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.192762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.192762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.192762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.193305] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.193305] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7c44ea9-34f2-45bb-bf52-dd72b3513eda is going to be created. [ 696.208358] env[70520]: INFO networking_nsxv3.common.synchronization [req-a5cbb210-7f2f-47f8-8417-0537ca69cfdc req-bf2d3e23-d153-44f4-b8ee-bcebbce21aec tempest-MigrationsAdminTest-360924409 tempest-MigrationsAdminTest-360924409-project-member] Enqueued Resource ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 with Priority: HIGHEST for action security_group_members [ 696.208939] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 with Priority: HIGHEST for action security_group_members [ 696.209346] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f391db-1908-4d0d-afa1-a1da6f6944f6 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.209661] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.209661] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.209841] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.209997] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.210117] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.210181] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.210708] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.210816] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.210926] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17f391db-1908-4d0d-afa1-a1da6f6944f6',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.277127] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.277383] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.277445] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.277779] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.277931] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.289958] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7c44ea9-34f2-45bb-bf52-dd72b3513eda in Status: IN_PROGRESS for 2s [ 696.523227] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f33295b0-1d2b-4766-9487-c97d9b92c65c [ 696.523227] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.523227] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.523227] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.523410] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.523445] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.523524] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f33295b0-1d2b-4766-9487-c97d9b92c65c already deleted. [ 696.523646] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f33295b0-1d2b-4766-9487-c97d9b92c65c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.557693] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22824640-0730-4b9a-a9ef-9014ef216bc4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.713550] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.713550] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.713550] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.713760] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.713792] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.714401] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.714401] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.714401] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.714401] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.714401] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.715129] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 already deleted. [ 696.715129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.045779] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84213b0-a32e-49bf-97aa-67c24de8104c in Status: SUCCESS [ 697.046051] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.046242] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.046463] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.046696] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.046993] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.046993] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.047096] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.047133] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.047224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.047317] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e84213b0-a32e-49bf-97aa-67c24de8104c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.067427] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.067427] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.067427] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.067782] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.067959] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.068124] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 is going to be created. [ 697.084498] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-659 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.084927] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.085075] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.085557] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.086731] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.086731] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.086731] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.086981] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.089020] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.089020] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 697.089020] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 697.089020] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 697.089020] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 697.089020] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 697.089020] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 697.089020] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 697.100574] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.100775] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.100835] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.101077] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.101242] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.109926] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 697.110144] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 697.110401] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 697.110699] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.111134] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-043ebeed-c68a-4794-a3f2-c54a0f8a4377 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.111312] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-043ebeed-c68a-4794-a3f2-c54a0f8a4377" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.112014] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-043ebeed-c68a-4794-a3f2-c54a0f8a4377" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.112014] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-043ebeed-c68a-4794-a3f2-c54a0f8a4377" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.115768] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('043ebeed-c68a-4794-a3f2-c54a0f8a4377',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.117337] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 in Status: UNINITIALIZED for 2s [ 697.550647] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84213b0-a32e-49bf-97aa-67c24de8104c taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.550828] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.551042] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.551403] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.551403] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.551403] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.551571] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.551656] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.551687] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.551759] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.551896] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84213b0-a32e-49bf-97aa-67c24de8104c taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.551984] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.552057] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.552195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.552402] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.552494] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.552551] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.552704] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.552777] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.552853] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.552937] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e84213b0-a32e-49bf-97aa-67c24de8104c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.618902] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.619413] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.619413] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.620087] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.620253] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.620400] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 043ebeed-c68a-4794-a3f2-c54a0f8a4377 not found, creating... [ 697.620717] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.620871] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.620986] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.621631] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.621799] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.622183] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.622345] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.622661] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.622917] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.623073] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.623254] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 043ebeed-c68a-4794-a3f2-c54a0f8a4377 is going to be created. [ 697.649852] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.649852] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.649852] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.649852] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.649852] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.649852] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-043ebeed-c68a-4794-a3f2-c54a0f8a4377" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.055991] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e84213b0-a32e-49bf-97aa-67c24de8104c: rpc.has_security_group_logging(os_id): False [ 698.079139] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.079263] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.079850] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.080174] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.080383] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.080670] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.081891] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.081967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.082164] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.082244] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.082482] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.082577] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.082633] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.082773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.082843] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.084128] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.084537] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.084714] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.086562] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.086562] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.086562] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e84213b0-a32e-49bf-97aa-67c24de8104c is going to be created. [ 698.173832] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.173832] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.174032] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.174224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.175586] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.196026] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e84213b0-a32e-49bf-97aa-67c24de8104c in Status: IN_PROGRESS for 2s [ 698.208747] env[70520]: INFO networking_nsxv3.common.synchronization [None req-9d4ee7dd-2e5a-448c-a645-cb010dc74b4a None None] Enqueued Resource ID: a6bd776c-581b-4012-94c9-d7aa9c8eca7d with Priority: HIGHEST for action port [ 698.208884] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6bd776c-581b-4012-94c9-d7aa9c8eca7d with Priority: HIGHEST for action port [ 698.209943] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6bd776c-581b-4012-94c9-d7aa9c8eca7d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.209943] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6bd776c-581b-4012-94c9-d7aa9c8eca7d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.209943] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6bd776c-581b-4012-94c9-d7aa9c8eca7d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.210236] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6bd776c-581b-4012-94c9-d7aa9c8eca7d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.211209] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6bd776c-581b-4012-94c9-d7aa9c8eca7d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.306138] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7c44ea9-34f2-45bb-bf52-dd72b3513eda in Status: SUCCESS [ 698.306461] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.391026] env[70520]: INFO networking_nsxv3.common.synchronization [req-8ced01f8-71dd-4ec7-8d66-06855fb5c8d2 req-29f1d0a3-5f3f-4fd5-9f09-710d24d20e81 tempest-VolumesAdminNegativeTest-725810316 tempest-VolumesAdminNegativeTest-725810316-project-member] Enqueued Resource ID: 4686572e-3137-42e1-a568-9db02b6e5e1c with Priority: HIGHEST for action security_group_members [ 698.391026] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4686572e-3137-42e1-a568-9db02b6e5e1c with Priority: HIGHEST for action security_group_members [ 698.391395] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-4686572e-3137-42e1-a568-9db02b6e5e1c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.391652] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.391800] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.392145] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.392480] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.392734] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.392988] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.393249] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.393699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.393927] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4686572e-3137-42e1-a568-9db02b6e5e1c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.716350] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a6bd776c-581b-4012-94c9-d7aa9c8eca7d [ 698.717220] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.717220] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.717220] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.717220] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.717220] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.717220] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a6bd776c-581b-4012-94c9-d7aa9c8eca7d already deleted. [ 698.717572] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6bd776c-581b-4012-94c9-d7aa9c8eca7d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.807772] env[70520]: INFO networking_nsxv3.common.synchronization [req-a5cbb210-7f2f-47f8-8417-0537ca69cfdc req-fdeb1b91-d49d-4c65-bc3d-bee55f9c272f service nova] Enqueued Resource ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 with Priority: HIGHEST for action security_group_rules [ 698.807964] env[70520]: INFO networking_nsxv3.common.synchronization [req-a5cbb210-7f2f-47f8-8417-0537ca69cfdc req-fdeb1b91-d49d-4c65-bc3d-bee55f9c272f service nova] Enqueued Resource ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 with Priority: HIGHEST for action security_group_members [ 698.808119] env[70520]: INFO networking_nsxv3.common.synchronization [req-a5cbb210-7f2f-47f8-8417-0537ca69cfdc req-fdeb1b91-d49d-4c65-bc3d-bee55f9c272f service nova] Enqueued Resource ID: 043ebeed-c68a-4794-a3f2-c54a0f8a4377 with Priority: HIGHEST for action port [ 698.808729] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 with Priority: HIGHEST for action security_group_rules [ 698.808892] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 with Priority: HIGHEST for action security_group_members [ 698.809881] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 043ebeed-c68a-4794-a3f2-c54a0f8a4377 with Priority: HIGHEST for action port [ 698.809881] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17f391db-1908-4d0d-afa1-a1da6f6944f6 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.810183] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.810183] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.810295] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.810328] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17f391db-1908-4d0d-afa1-a1da6f6944f6',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.811835] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f391db-1908-4d0d-afa1-a1da6f6944f6 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.812050] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.812050] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.812182] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.812333] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.812427] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.812477] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.812628] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.815505] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.815625] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17f391db-1908-4d0d-afa1-a1da6f6944f6',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.816857] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-043ebeed-c68a-4794-a3f2-c54a0f8a4377 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.817159] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-043ebeed-c68a-4794-a3f2-c54a0f8a4377" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.817159] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-043ebeed-c68a-4794-a3f2-c54a0f8a4377" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.817313] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-043ebeed-c68a-4794-a3f2-c54a0f8a4377" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.817355] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('043ebeed-c68a-4794-a3f2-c54a0f8a4377',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.897947] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.897947] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.897947] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.897947] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.897947] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.897947] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.897947] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.897947] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.897947] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.898310] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.898310] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4686572e-3137-42e1-a568-9db02b6e5e1c already deleted. [ 698.898310] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.980118] env[70520]: INFO networking_nsxv3.common.synchronization [req-c2f498ac-a7e4-4492-a869-fc575a9df9aa req-57a4ba44-e021-4aed-a29c-d2ad618bdb38 tempest-SecurityGroupRulesTestJSON-1452818246 tempest-SecurityGroupRulesTestJSON-1452818246-project-member] Enqueued Resource ID: a3ea8c7f-5632-4ae0-b53a-6892b5aded75 with Priority: HIGHEST for action security_group_rules [ 698.981024] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3ea8c7f-5632-4ae0-b53a-6892b5aded75 with Priority: HIGHEST for action security_group_rules [ 698.981683] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3ea8c7f-5632-4ae0-b53a-6892b5aded75 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.981888] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3ea8c7f-5632-4ae0-b53a-6892b5aded75" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.982056] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3ea8c7f-5632-4ae0-b53a-6892b5aded75" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.982418] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3ea8c7f-5632-4ae0-b53a-6892b5aded75" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.984133] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3ea8c7f-5632-4ae0-b53a-6892b5aded75',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.062975] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-23 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.063625] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.063625] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.063808] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.064051] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.064858] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.065043] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.065306] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.065464] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.065676] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 699.065819] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 699.065884] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 699.066019] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 699.066219] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 699.066423] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 699.066638] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 699.093351] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 699.093607] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 699.093813] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 699.094037] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.094480] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-dda56ee0-696b-4d69-ae68-3cfe9e6324bc taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.095204] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-dda56ee0-696b-4d69-ae68-3cfe9e6324bc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.095204] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-dda56ee0-696b-4d69-ae68-3cfe9e6324bc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.095204] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-dda56ee0-696b-4d69-ae68-3cfe9e6324bc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.095376] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dda56ee0-696b-4d69-ae68-3cfe9e6324bc',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.131376] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 in Status: SUCCESS [ 699.131630] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.132338] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.132828] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.133385] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.133529] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.133529] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.133791] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.133927] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.134097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.134236] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22824640-0730-4b9a-a9ef-9014ef216bc4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.321189] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f391db-1908-4d0d-afa1-a1da6f6944f6 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.321189] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.324491] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17f391db-1908-4d0d-afa1-a1da6f6944f6',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.325517] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 043ebeed-c68a-4794-a3f2-c54a0f8a4377 with status ACTIVE [ 699.325757] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.325907] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.325980] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.326208] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.326297] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.326524] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.326659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.327482] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.327482] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.327482] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.327482] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.327482] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.327482] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.328383] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.328383] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.328383] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 043ebeed-c68a-4794-a3f2-c54a0f8a4377 is going to be updated. [ 699.352880] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.352880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.352880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.352880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.354184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.354950] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-043ebeed-c68a-4794-a3f2-c54a0f8a4377" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.505103] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.506368] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.506368] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.506368] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.506368] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.506368] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3ea8c7f-5632-4ae0-b53a-6892b5aded75 already deleted. [ 699.506368] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3ea8c7f-5632-4ae0-b53a-6892b5aded75" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.599820] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.600098] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.600228] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.600575] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.600741] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.601164] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port dda56ee0-696b-4d69-ae68-3cfe9e6324bc not found, creating... [ 699.601583] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.601825] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.602566] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.602862] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.603039] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.603399] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.603587] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.603891] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.603956] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.607629] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.607629] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: dda56ee0-696b-4d69-ae68-3cfe9e6324bc is going to be created. [ 699.628281] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.628417] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.628515] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.628815] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.629069] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.629413] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-dda56ee0-696b-4d69-ae68-3cfe9e6324bc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.637073] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-22824640-0730-4b9a-a9ef-9014ef216bc4 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.637226] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.637293] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.637570] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.637751] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.637858] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.637973] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.638080] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.638158] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.638250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.638401] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-22824640-0730-4b9a-a9ef-9014ef216bc4 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.638824] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.638824] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.638824] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.638824] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.639235] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.639235] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.639235] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.639235] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.639235] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.639407] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22824640-0730-4b9a-a9ef-9014ef216bc4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.829996] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17f391db-1908-4d0d-afa1-a1da6f6944f6',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.143204] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22824640-0730-4b9a-a9ef-9014ef216bc4: rpc.has_security_group_logging(os_id): False [ 700.167057] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.167403] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.167403] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.167640] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.167865] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.168238] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.168238] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.168238] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.168466] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.168466] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.168673] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.168785] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.168852] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.169256] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.169537] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.169609] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.169688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.169850] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.169944] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.169944] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.170224] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 is going to be created. [ 700.222675] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e84213b0-a32e-49bf-97aa-67c24de8104c in Status: SUCCESS [ 700.222983] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.256764] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.257253] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.257347] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.257521] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.257694] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.272452] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 in Status: IN_PROGRESS for 2s [ 700.289756] env[70520]: INFO networking_nsxv3.common.synchronization [req-9128d315-87eb-442d-ac97-3666815c6aa2 req-86269d12-3612-4dc0-bc45-5f5fd7e4dd8d tempest-SecurityGroupRulesTestJSON-1452818246 tempest-SecurityGroupRulesTestJSON-1452818246-project-member] Enqueued Resource ID: a3ea8c7f-5632-4ae0-b53a-6892b5aded75 with Priority: HIGHEST for action security_group_rules [ 700.290519] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3ea8c7f-5632-4ae0-b53a-6892b5aded75 with Priority: HIGHEST for action security_group_rules [ 700.291263] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3ea8c7f-5632-4ae0-b53a-6892b5aded75 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.291406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3ea8c7f-5632-4ae0-b53a-6892b5aded75" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.291471] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3ea8c7f-5632-4ae0-b53a-6892b5aded75" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.291697] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3ea8c7f-5632-4ae0-b53a-6892b5aded75" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.291787] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3ea8c7f-5632-4ae0-b53a-6892b5aded75',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.333148] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.333331] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.333374] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.333589] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.333681] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.333928] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 is going to be created. [ 700.381330] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.381518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.381564] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.381803] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.381970] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.392928] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 in Status: UNINITIALIZED for 2s [ 700.817663] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.817663] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.817663] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.817663] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.817663] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.817663] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3ea8c7f-5632-4ae0-b53a-6892b5aded75 already deleted. [ 700.817663] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3ea8c7f-5632-4ae0-b53a-6892b5aded75" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.314639] env[70520]: INFO networking_nsxv3.common.synchronization [req-8ced01f8-71dd-4ec7-8d66-06855fb5c8d2 req-4befdeb2-6290-4f47-a537-bec6c3f1b9db service nova] Enqueued Resource ID: 4686572e-3137-42e1-a568-9db02b6e5e1c with Priority: HIGHEST for action security_group_rules [ 701.314882] env[70520]: INFO networking_nsxv3.common.synchronization [req-8ced01f8-71dd-4ec7-8d66-06855fb5c8d2 req-4befdeb2-6290-4f47-a537-bec6c3f1b9db service nova] Enqueued Resource ID: 4686572e-3137-42e1-a568-9db02b6e5e1c with Priority: HIGHEST for action security_group_members [ 701.314992] env[70520]: INFO networking_nsxv3.common.synchronization [req-8ced01f8-71dd-4ec7-8d66-06855fb5c8d2 req-4befdeb2-6290-4f47-a537-bec6c3f1b9db service nova] Enqueued Resource ID: dda56ee0-696b-4d69-ae68-3cfe9e6324bc with Priority: HIGHEST for action port [ 701.315748] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4686572e-3137-42e1-a568-9db02b6e5e1c with Priority: HIGHEST for action security_group_rules [ 701.315917] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4686572e-3137-42e1-a568-9db02b6e5e1c with Priority: HIGHEST for action security_group_members [ 701.316033] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dda56ee0-696b-4d69-ae68-3cfe9e6324bc with Priority: HIGHEST for action port [ 701.316335] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4686572e-3137-42e1-a568-9db02b6e5e1c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.316476] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.316541] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.316746] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.316829] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4686572e-3137-42e1-a568-9db02b6e5e1c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.318890] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-4686572e-3137-42e1-a568-9db02b6e5e1c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.319040] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.320980] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.320980] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.320980] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.320980] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.320980] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.320980] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.320980] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.320980] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4686572e-3137-42e1-a568-9db02b6e5e1c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.322992] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-dda56ee0-696b-4d69-ae68-3cfe9e6324bc taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.322992] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dda56ee0-696b-4d69-ae68-3cfe9e6324bc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.322992] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dda56ee0-696b-4d69-ae68-3cfe9e6324bc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.322992] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dda56ee0-696b-4d69-ae68-3cfe9e6324bc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.322992] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dda56ee0-696b-4d69-ae68-3cfe9e6324bc',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.376259] env[70520]: INFO networking_nsxv3.common.synchronization [req-c9af87fe-fcc6-4173-ab69-5cf8e988138a req-afb28964-5778-4a18-8221-f457caf6444a tempest-ServersAdminNegativeTestJSON-263885956 tempest-ServersAdminNegativeTestJSON-263885956-project-member] Enqueued Resource ID: 5ba096e8-0990-4301-b10d-dee4aea7793e with Priority: HIGHEST for action security_group_members [ 701.377654] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ba096e8-0990-4301-b10d-dee4aea7793e with Priority: HIGHEST for action security_group_members [ 701.377840] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ba096e8-0990-4301-b10d-dee4aea7793e taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.377988] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.378112] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.378947] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.378947] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.378947] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.378947] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.379130] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.379130] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.379204] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ba096e8-0990-4301-b10d-dee4aea7793e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.819691] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-4686572e-3137-42e1-a568-9db02b6e5e1c taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.819852] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.823359] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4686572e-3137-42e1-a568-9db02b6e5e1c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.824235] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dda56ee0-696b-4d69-ae68-3cfe9e6324bc with status ACTIVE [ 701.824474] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.824605] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.824674] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.824878] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.824966] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.825157] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.825258] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.825337] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.825489] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.825564] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.825746] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.825870] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.825903] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.827089] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.827089] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.828530] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dda56ee0-696b-4d69-ae68-3cfe9e6324bc is going to be updated. [ 701.858815] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.859560] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.859560] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.859560] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.859719] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.860240] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dda56ee0-696b-4d69-ae68-3cfe9e6324bc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.868741] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-659 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.869666] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.869740] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.870136] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.870432] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.871209] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.871277] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.872742] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.872742] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.872873] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 701.872969] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 701.873096] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 701.873273] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 701.873323] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 701.873421] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 701.873589] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 701.883354] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.883522] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.883564] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.884026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.884026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.884147] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.884147] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.884260] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.884654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.884654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.884654] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ba096e8-0990-4301-b10d-dee4aea7793e already deleted. [ 701.884654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.897287] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 701.897474] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 701.897616] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 701.897790] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.898151] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-287771eb-72bf-4c0f-ab88-a32d02119b38 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.898743] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-287771eb-72bf-4c0f-ab88-a32d02119b38" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.898743] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-287771eb-72bf-4c0f-ab88-a32d02119b38" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.898924] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-287771eb-72bf-4c0f-ab88-a32d02119b38" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.898924] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('287771eb-72bf-4c0f-ab88-a32d02119b38',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.297294] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 in Status: SUCCESS [ 702.297498] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.330096] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4686572e-3137-42e1-a568-9db02b6e5e1c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.403522] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.403522] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.403686] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.403878] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.404012] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.404324] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 287771eb-72bf-4c0f-ab88-a32d02119b38 not found, creating... [ 702.404484] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.404857] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.404857] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.405026] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.405206] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.405469] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.405583] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.405700] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.405916] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.408796] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.409108] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 287771eb-72bf-4c0f-ab88-a32d02119b38 is going to be created. [ 702.410735] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 in Status: SUCCESS [ 702.410871] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.411379] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.411565] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.411731] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.411837] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.411901] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.416948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.417090] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.417196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.417297] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17f391db-1908-4d0d-afa1-a1da6f6944f6',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.439284] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.439497] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.439705] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.439906] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.440199] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.444021] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-287771eb-72bf-4c0f-ab88-a32d02119b38" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.832325] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.832656] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.832656] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.832808] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.832877] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.832978] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4686572e-3137-42e1-a568-9db02b6e5e1c is going to be created. [ 702.863056] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.863286] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.863361] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.864723] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.864723] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.881825] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4686572e-3137-42e1-a568-9db02b6e5e1c in Status: UNINITIALIZED for 2s [ 702.924950] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f391db-1908-4d0d-afa1-a1da6f6944f6 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.925701] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.925701] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.925701] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.925843] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.925843] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.925942] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.926569] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.926569] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.926569] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.926569] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f391db-1908-4d0d-afa1-a1da6f6944f6 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.926788] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.926788] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.926788] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.926930] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.929721] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.929721] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.929952] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.930020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.930121] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.930275] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17f391db-1908-4d0d-afa1-a1da6f6944f6',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.433313] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17f391db-1908-4d0d-afa1-a1da6f6944f6: rpc.has_security_group_logging(os_id): False [ 703.455496] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.455496] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.455496] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.455496] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.455496] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.455771] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.455771] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.455867] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.457940] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.457940] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.457940] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.457940] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.457940] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.457940] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.457940] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.457940] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.457940] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.457940] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.457940] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.457940] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.457940] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 is going to be created. [ 703.533723] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.533723] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.533723] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.533723] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.534236] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.547335] env[70520]: INFO networking_nsxv3.common.synchronization [req-6c88dc1b-4487-4108-a452-1fd385066aa0 req-927595a1-2274-45a1-860a-7611ab7527b2 tempest-SecurityGroupRulesTestJSON-1452818246 tempest-SecurityGroupRulesTestJSON-1452818246-project-member] Enqueued Resource ID: a3ea8c7f-5632-4ae0-b53a-6892b5aded75 with Priority: HIGHEST for action security_group_rules [ 703.548232] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3ea8c7f-5632-4ae0-b53a-6892b5aded75 with Priority: HIGHEST for action security_group_rules [ 703.549476] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 in Status: IN_PROGRESS for 2s [ 703.549900] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3ea8c7f-5632-4ae0-b53a-6892b5aded75 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.550163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3ea8c7f-5632-4ae0-b53a-6892b5aded75" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.550315] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3ea8c7f-5632-4ae0-b53a-6892b5aded75" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.550708] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3ea8c7f-5632-4ae0-b53a-6892b5aded75" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.550907] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3ea8c7f-5632-4ae0-b53a-6892b5aded75',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.669510] env[70520]: INFO networking_nsxv3.common.synchronization [req-69367f61-8c22-4709-a475-4d357925edd8 req-973f8d70-8508-43a6-bc75-6a808206f4a4 tempest-ImagesOneServerTestJSON-591360188 tempest-ImagesOneServerTestJSON-591360188-project-member] Enqueued Resource ID: bc967d33-6d28-4dd5-98c4-22ac5cda2d2e with Priority: HIGHEST for action security_group_members [ 703.670824] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc967d33-6d28-4dd5-98c4-22ac5cda2d2e with Priority: HIGHEST for action security_group_members [ 703.671390] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.671545] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.671637] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.671949] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.672188] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.672395] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.672963] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.672963] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.672963] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.672963] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc967d33-6d28-4dd5-98c4-22ac5cda2d2e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.776657] env[70520]: INFO networking_nsxv3.common.synchronization [req-c9af87fe-fcc6-4173-ab69-5cf8e988138a req-078018dd-09b0-4a32-b3f4-c8bb7cc15cd4 service nova] Enqueued Resource ID: 5ba096e8-0990-4301-b10d-dee4aea7793e with Priority: HIGHEST for action security_group_rules [ 703.776975] env[70520]: INFO networking_nsxv3.common.synchronization [req-c9af87fe-fcc6-4173-ab69-5cf8e988138a req-078018dd-09b0-4a32-b3f4-c8bb7cc15cd4 service nova] Enqueued Resource ID: 5ba096e8-0990-4301-b10d-dee4aea7793e with Priority: HIGHEST for action security_group_members [ 703.777095] env[70520]: INFO networking_nsxv3.common.synchronization [req-c9af87fe-fcc6-4173-ab69-5cf8e988138a req-078018dd-09b0-4a32-b3f4-c8bb7cc15cd4 service nova] Enqueued Resource ID: 287771eb-72bf-4c0f-ab88-a32d02119b38 with Priority: HIGHEST for action port [ 703.780024] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ba096e8-0990-4301-b10d-dee4aea7793e with Priority: HIGHEST for action security_group_rules [ 703.780024] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ba096e8-0990-4301-b10d-dee4aea7793e with Priority: HIGHEST for action security_group_members [ 703.780024] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 287771eb-72bf-4c0f-ab88-a32d02119b38 with Priority: HIGHEST for action port [ 703.780024] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ba096e8-0990-4301-b10d-dee4aea7793e taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.780024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.780024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.782523] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.782523] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ba096e8-0990-4301-b10d-dee4aea7793e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.783640] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ba096e8-0990-4301-b10d-dee4aea7793e taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.783854] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.783989] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.784544] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.784782] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.784976] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.785112] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.785362] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.785429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.786163] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ba096e8-0990-4301-b10d-dee4aea7793e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.787144] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-287771eb-72bf-4c0f-ab88-a32d02119b38 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.788650] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-287771eb-72bf-4c0f-ab88-a32d02119b38" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.788650] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-287771eb-72bf-4c0f-ab88-a32d02119b38" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.788650] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-287771eb-72bf-4c0f-ab88-a32d02119b38" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.788650] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('287771eb-72bf-4c0f-ab88-a32d02119b38',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.889469] env[70520]: INFO networking_nsxv3.common.synchronization [None req-6be82adc-bf0e-4d16-9119-6ddd5bd1a6d5 None None] Enqueued Resource ID: 740fa35c-317c-48db-838e-67068c98801e with Priority: HIGHEST for action port [ 703.889469] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 740fa35c-317c-48db-838e-67068c98801e with Priority: HIGHEST for action port [ 703.889469] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-740fa35c-317c-48db-838e-67068c98801e taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.889469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-740fa35c-317c-48db-838e-67068c98801e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.889469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-740fa35c-317c-48db-838e-67068c98801e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.889469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-740fa35c-317c-48db-838e-67068c98801e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.889469] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('740fa35c-317c-48db-838e-67068c98801e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.071414] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.071576] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.071632] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.072228] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.072228] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.072228] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3ea8c7f-5632-4ae0-b53a-6892b5aded75 already deleted. [ 704.072228] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3ea8c7f-5632-4ae0-b53a-6892b5aded75" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.177517] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.177517] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.177517] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.177517] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.177517] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.177517] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.177517] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.177517] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.177517] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.181062] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.181062] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc967d33-6d28-4dd5-98c4-22ac5cda2d2e already deleted. [ 704.181062] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.284901] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ba096e8-0990-4301-b10d-dee4aea7793e taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.285046] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.290885] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 287771eb-72bf-4c0f-ab88-a32d02119b38 with status ACTIVE [ 704.291152] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.291290] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.291358] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.291577] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.291732] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.291835] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.291970] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.292018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.295028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.295028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.295028] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.295028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.295028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.295028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.295028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.295028] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 287771eb-72bf-4c0f-ab88-a32d02119b38 is going to be updated. [ 704.295028] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5ba096e8-0990-4301-b10d-dee4aea7793e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.320181] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.320394] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.320394] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.321561] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.321561] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.321561] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-287771eb-72bf-4c0f-ab88-a32d02119b38" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.394661] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 740fa35c-317c-48db-838e-67068c98801e [ 704.394976] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.395136] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.395206] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.395433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.395536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.395760] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:740fa35c-317c-48db-838e-67068c98801e already deleted. [ 704.395809] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-740fa35c-317c-48db-838e-67068c98801e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.796694] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5ba096e8-0990-4301-b10d-dee4aea7793e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.804234] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.804453] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.804585] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.804902] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.805189] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.805359] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.805488] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.805703] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.805842] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.810777] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 704.810777] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 704.811555] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 704.811555] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 704.811555] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 704.811555] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 704.811555] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 704.832933] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 704.833115] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 704.833233] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 704.833404] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.833706] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-adc1c5e2-7a2e-4b4a-8dda-fbf04920f7bb taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.833874] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-adc1c5e2-7a2e-4b4a-8dda-fbf04920f7bb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.833989] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-adc1c5e2-7a2e-4b4a-8dda-fbf04920f7bb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.834415] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-adc1c5e2-7a2e-4b4a-8dda-fbf04920f7bb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.836051] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adc1c5e2-7a2e-4b4a-8dda-fbf04920f7bb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.893574] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4686572e-3137-42e1-a568-9db02b6e5e1c in Status: SUCCESS [ 704.896251] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.896535] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.896812] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.897126] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.897268] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.897335] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.897522] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.897628] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.897762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.897804] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4686572e-3137-42e1-a568-9db02b6e5e1c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.301510] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.301766] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.301907] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.302315] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.303270] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.303270] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ba096e8-0990-4301-b10d-dee4aea7793e is going to be created. [ 705.329375] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.329554] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.329628] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.329856] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.330052] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.340838] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.341080] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.341200] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.342229] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.342229] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.342229] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port adc1c5e2-7a2e-4b4a-8dda-fbf04920f7bb not found, creating... [ 705.342229] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.342229] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.343331] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.343331] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.343503] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.343866] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.344106] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.344187] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.344423] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.344571] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.344717] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: adc1c5e2-7a2e-4b4a-8dda-fbf04920f7bb is going to be created. [ 705.346835] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ba096e8-0990-4301-b10d-dee4aea7793e in Status: UNINITIALIZED for 2s [ 705.371857] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.371857] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.371857] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.371857] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.371857] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.371857] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-adc1c5e2-7a2e-4b4a-8dda-fbf04920f7bb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.401460] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4686572e-3137-42e1-a568-9db02b6e5e1c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.517716] env[70520]: INFO networking_nsxv3.common.synchronization [None req-0d0a61e2-6627-4b1c-bd5e-65676da6b7ae None None] Enqueued Resource ID: 8815305e-aee1-4a16-9e1a-4abe773248f9 with Priority: HIGHEST for action port [ 705.518676] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8815305e-aee1-4a16-9e1a-4abe773248f9 with Priority: HIGHEST for action port [ 705.519143] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-8815305e-aee1-4a16-9e1a-4abe773248f9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.519357] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8815305e-aee1-4a16-9e1a-4abe773248f9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.519464] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8815305e-aee1-4a16-9e1a-4abe773248f9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.519778] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8815305e-aee1-4a16-9e1a-4abe773248f9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.519915] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8815305e-aee1-4a16-9e1a-4abe773248f9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.570248] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 in Status: SUCCESS [ 705.570248] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.911775] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4686572e-3137-42e1-a568-9db02b6e5e1c: rpc.has_security_group_logging(os_id): False [ 705.934907] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.934907] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.934907] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.934907] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.934907] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.934907] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.934907] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.935249] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.935249] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.935249] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.935389] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4686572e-3137-42e1-a568-9db02b6e5e1c is going to be created. [ 706.027697] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8815305e-aee1-4a16-9e1a-4abe773248f9 [ 706.027697] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.027697] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.027697] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.027697] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.027697] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.027697] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8815305e-aee1-4a16-9e1a-4abe773248f9 already deleted. [ 706.027697] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8815305e-aee1-4a16-9e1a-4abe773248f9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.032857] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.033033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.033033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.033215] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.033454] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.052720] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4686572e-3137-42e1-a568-9db02b6e5e1c in Status: IN_PROGRESS for 2s [ 706.183481] env[70520]: INFO networking_nsxv3.common.synchronization [req-69367f61-8c22-4709-a475-4d357925edd8 req-8f87b42d-339b-45f5-82ec-0d30daf86b96 service nova] Enqueued Resource ID: bc967d33-6d28-4dd5-98c4-22ac5cda2d2e with Priority: HIGHEST for action security_group_rules [ 706.183691] env[70520]: INFO networking_nsxv3.common.synchronization [req-69367f61-8c22-4709-a475-4d357925edd8 req-8f87b42d-339b-45f5-82ec-0d30daf86b96 service nova] Enqueued Resource ID: bc967d33-6d28-4dd5-98c4-22ac5cda2d2e with Priority: HIGHEST for action security_group_members [ 706.183841] env[70520]: INFO networking_nsxv3.common.synchronization [req-69367f61-8c22-4709-a475-4d357925edd8 req-8f87b42d-339b-45f5-82ec-0d30daf86b96 service nova] Enqueued Resource ID: adc1c5e2-7a2e-4b4a-8dda-fbf04920f7bb with Priority: HIGHEST for action port [ 706.184084] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc967d33-6d28-4dd5-98c4-22ac5cda2d2e with Priority: HIGHEST for action security_group_rules [ 706.184220] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc967d33-6d28-4dd5-98c4-22ac5cda2d2e with Priority: HIGHEST for action security_group_members [ 706.184320] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adc1c5e2-7a2e-4b4a-8dda-fbf04920f7bb with Priority: HIGHEST for action port [ 706.184907] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.186316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.186593] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.186873] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.186985] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc967d33-6d28-4dd5-98c4-22ac5cda2d2e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.192026] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.192026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.192026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.192026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.192026] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.192026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.192026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.192026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.192026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.192026] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc967d33-6d28-4dd5-98c4-22ac5cda2d2e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.192026] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-adc1c5e2-7a2e-4b4a-8dda-fbf04920f7bb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.192026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-adc1c5e2-7a2e-4b4a-8dda-fbf04920f7bb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.193416] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-adc1c5e2-7a2e-4b4a-8dda-fbf04920f7bb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.193603] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-adc1c5e2-7a2e-4b4a-8dda-fbf04920f7bb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.193675] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adc1c5e2-7a2e-4b4a-8dda-fbf04920f7bb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.520909] env[70520]: INFO networking_nsxv3.common.synchronization [None req-19ac275b-e654-4ae9-b898-a753324f9fb5 None None] Enqueued Resource ID: baf8f1f6-e2c6-41a7-8189-4b9ff02663d0 with Priority: HIGHEST for action port [ 706.521467] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baf8f1f6-e2c6-41a7-8189-4b9ff02663d0 with Priority: HIGHEST for action port [ 706.521778] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-baf8f1f6-e2c6-41a7-8189-4b9ff02663d0 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.521906] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-baf8f1f6-e2c6-41a7-8189-4b9ff02663d0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.521974] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-baf8f1f6-e2c6-41a7-8189-4b9ff02663d0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.524309] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-baf8f1f6-e2c6-41a7-8189-4b9ff02663d0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.524309] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('baf8f1f6-e2c6-41a7-8189-4b9ff02663d0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.699409] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.700905] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.701250] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc967d33-6d28-4dd5-98c4-22ac5cda2d2e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.702256] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port adc1c5e2-7a2e-4b4a-8dda-fbf04920f7bb with status ACTIVE [ 706.702510] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.702607] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.702675] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.702872] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.702959] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.703164] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.703256] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.703340] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.703450] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.706393] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.706393] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.706393] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.706393] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.706393] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.706393] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.706590] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: adc1c5e2-7a2e-4b4a-8dda-fbf04920f7bb is going to be updated. [ 706.732908] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.733770] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.733770] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.733770] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.733770] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.733939] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-adc1c5e2-7a2e-4b4a-8dda-fbf04920f7bb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.028020] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port baf8f1f6-e2c6-41a7-8189-4b9ff02663d0 [ 707.028517] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.028633] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.028737] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.029184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.029184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.029696] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:baf8f1f6-e2c6-41a7-8189-4b9ff02663d0 already deleted. [ 707.029971] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-baf8f1f6-e2c6-41a7-8189-4b9ff02663d0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.210351] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc967d33-6d28-4dd5-98c4-22ac5cda2d2e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.352514] env[70520]: INFO networking_nsxv3.common.synchronization [None req-cde49e96-f625-44c7-bfc0-3755029a201d None None] Enqueued Resource ID: 7a3c4ebe-d2ad-418c-966a-5e448985ecbd with Priority: HIGHEST for action port [ 707.354795] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a3c4ebe-d2ad-418c-966a-5e448985ecbd with Priority: HIGHEST for action port [ 707.354795] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a3c4ebe-d2ad-418c-966a-5e448985ecbd taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.354795] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a3c4ebe-d2ad-418c-966a-5e448985ecbd" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.354795] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a3c4ebe-d2ad-418c-966a-5e448985ecbd" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.355130] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a3c4ebe-d2ad-418c-966a-5e448985ecbd" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.355274] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a3c4ebe-d2ad-418c-966a-5e448985ecbd',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.360708] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ba096e8-0990-4301-b10d-dee4aea7793e in Status: SUCCESS [ 707.360708] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.361226] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.362174] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.362599] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.362923] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.362923] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.363653] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.363741] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.364038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.364038] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5ba096e8-0990-4301-b10d-dee4aea7793e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.715322] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.715709] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.715806] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.718841] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.718979] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.719125] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc967d33-6d28-4dd5-98c4-22ac5cda2d2e is going to be created. [ 707.750318] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.750472] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.750544] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.750761] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.750917] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.763063] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc967d33-6d28-4dd5-98c4-22ac5cda2d2e in Status: UNINITIALIZED for 2s [ 707.857366] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7a3c4ebe-d2ad-418c-966a-5e448985ecbd [ 707.859224] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.859224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.859224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.859224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.859224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.859224] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7a3c4ebe-d2ad-418c-966a-5e448985ecbd already deleted. [ 707.859224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a3c4ebe-d2ad-418c-966a-5e448985ecbd" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.870172] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ba096e8-0990-4301-b10d-dee4aea7793e taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.870172] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.870172] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.870172] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.870443] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.870443] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.870443] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.871152] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.871152] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.871152] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.871152] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ba096e8-0990-4301-b10d-dee4aea7793e taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.871152] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.871152] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.871369] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.871369] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.871440] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.871503] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.871637] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.871704] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.872100] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.872100] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5ba096e8-0990-4301-b10d-dee4aea7793e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.064971] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4686572e-3137-42e1-a568-9db02b6e5e1c in Status: SUCCESS [ 708.065255] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.255333] env[70520]: INFO networking_nsxv3.common.synchronization [None req-293c641a-89c0-41e2-9840-804d2a148a42 None None] Enqueued Resource ID: 1aa2b79b-5464-4850-87ec-d44e1d1ce41b with Priority: HIGHEST for action port [ 708.255333] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1aa2b79b-5464-4850-87ec-d44e1d1ce41b with Priority: HIGHEST for action port [ 708.255333] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-1aa2b79b-5464-4850-87ec-d44e1d1ce41b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.255333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1aa2b79b-5464-4850-87ec-d44e1d1ce41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.255333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1aa2b79b-5464-4850-87ec-d44e1d1ce41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.256887] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1aa2b79b-5464-4850-87ec-d44e1d1ce41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.257128] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1aa2b79b-5464-4850-87ec-d44e1d1ce41b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.378537] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5ba096e8-0990-4301-b10d-dee4aea7793e: rpc.has_security_group_logging(os_id): False [ 708.399035] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.399035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.399035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.399035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.399035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.399035] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.399035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.399035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.399035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.399035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.399035] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.399035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.399035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.399035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.399035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.402938] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.402938] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.402938] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.402938] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.402938] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.402938] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ba096e8-0990-4301-b10d-dee4aea7793e is going to be created. [ 708.464676] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.464891] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.464936] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.465175] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.465644] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.482417] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ba096e8-0990-4301-b10d-dee4aea7793e in Status: IN_PROGRESS for 2s [ 708.761671] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1aa2b79b-5464-4850-87ec-d44e1d1ce41b [ 708.764472] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.764472] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.764472] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.764472] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.764472] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.764472] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1aa2b79b-5464-4850-87ec-d44e1d1ce41b already deleted. [ 708.764472] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1aa2b79b-5464-4850-87ec-d44e1d1ce41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.255812] env[70520]: INFO networking_nsxv3.common.synchronization [None req-d5c5de22-26ef-4123-bbdf-dd2e1ab92c18 None None] Enqueued Resource ID: e14d39a0-9ea7-478d-b3d3-28c7da21d846 with Priority: HIGHEST for action port [ 709.257891] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e14d39a0-9ea7-478d-b3d3-28c7da21d846 with Priority: HIGHEST for action port [ 709.257891] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-e14d39a0-9ea7-478d-b3d3-28c7da21d846 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.257891] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e14d39a0-9ea7-478d-b3d3-28c7da21d846" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.257891] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e14d39a0-9ea7-478d-b3d3-28c7da21d846" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.257891] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e14d39a0-9ea7-478d-b3d3-28c7da21d846" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.258237] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e14d39a0-9ea7-478d-b3d3-28c7da21d846',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.763686] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e14d39a0-9ea7-478d-b3d3-28c7da21d846 [ 709.763869] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.764017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.764087] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.764310] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.764435] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.764510] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e14d39a0-9ea7-478d-b3d3-28c7da21d846 already deleted. [ 709.764593] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e14d39a0-9ea7-478d-b3d3-28c7da21d846" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.776182] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc967d33-6d28-4dd5-98c4-22ac5cda2d2e in Status: SUCCESS [ 709.776388] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.776955] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.777179] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.777364] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.777492] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.777549] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.777693] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.777768] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.777848] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.780251] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc967d33-6d28-4dd5-98c4-22ac5cda2d2e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.285343] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.287406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.287406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.287406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.287406] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.287406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.287406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.287406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.287406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.287406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.287406] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.287406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.287406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.287406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.287406] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.287406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.287406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.287406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.287406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.288112] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.288112] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc967d33-6d28-4dd5-98c4-22ac5cda2d2e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.372562] env[70520]: INFO networking_nsxv3.common.synchronization [None req-0526d12a-c6ea-4d26-a548-ee05307b51f8 None None] Enqueued Resource ID: 1454f3e4-57b7-46b4-bcce-ea5afe38d329 with Priority: HIGHEST for action port [ 710.374311] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1454f3e4-57b7-46b4-bcce-ea5afe38d329 with Priority: HIGHEST for action port [ 710.376208] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-1454f3e4-57b7-46b4-bcce-ea5afe38d329 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.378803] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1454f3e4-57b7-46b4-bcce-ea5afe38d329" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.378803] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1454f3e4-57b7-46b4-bcce-ea5afe38d329" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.378803] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1454f3e4-57b7-46b4-bcce-ea5afe38d329" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.378803] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1454f3e4-57b7-46b4-bcce-ea5afe38d329',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.505039] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ba096e8-0990-4301-b10d-dee4aea7793e in Status: SUCCESS [ 710.505039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.789732] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc967d33-6d28-4dd5-98c4-22ac5cda2d2e: rpc.has_security_group_logging(os_id): False [ 710.809296] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.809824] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.809987] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.810150] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.810269] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.810481] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.811317] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.811613] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.811903] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.812744] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.812952] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.813040] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.813355] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.813484] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.813574] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.814167] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.814346] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.814346] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.814606] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.814606] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.814681] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc967d33-6d28-4dd5-98c4-22ac5cda2d2e is going to be created. [ 710.881685] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1454f3e4-57b7-46b4-bcce-ea5afe38d329 [ 710.882533] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.882914] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.883118] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.883402] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.883608] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.883844] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1454f3e4-57b7-46b4-bcce-ea5afe38d329 already deleted. [ 710.884053] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1454f3e4-57b7-46b4-bcce-ea5afe38d329" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.886825] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.887293] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.887543] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.888093] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.890333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.901344] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc967d33-6d28-4dd5-98c4-22ac5cda2d2e in Status: IN_PROGRESS for 2s [ 711.375104] env[70520]: INFO networking_nsxv3.common.synchronization [req-1522b0e6-d9d0-40d0-b77c-cb11c1f2f936 req-51826876-2c13-4df7-b7bb-de8bb7f36f37 tempest-InstanceActionsTestJSON-1456976107 tempest-InstanceActionsTestJSON-1456976107-project-member] Enqueued Resource ID: 4e11ed3d-a638-4666-83ac-41d49f4f9874 with Priority: HIGHEST for action security_group_members [ 711.375104] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e11ed3d-a638-4666-83ac-41d49f4f9874 with Priority: HIGHEST for action security_group_members [ 711.375104] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e11ed3d-a638-4666-83ac-41d49f4f9874 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.375104] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.375104] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.375104] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.375587] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.375587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.375587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.375712] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.375852] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.375898] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e11ed3d-a638-4666-83ac-41d49f4f9874',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.380528] env[70520]: INFO networking_nsxv3.common.synchronization [None req-0b92534b-9a49-4209-b8c1-dedfb3a15323 None None] Enqueued Resource ID: cbd21bfd-b28c-42de-8d6f-04f40937d6b5 with Priority: HIGHEST for action port [ 711.382998] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbd21bfd-b28c-42de-8d6f-04f40937d6b5 with Priority: HIGHEST for action port [ 711.383490] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbd21bfd-b28c-42de-8d6f-04f40937d6b5 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.383622] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbd21bfd-b28c-42de-8d6f-04f40937d6b5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.383723] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbd21bfd-b28c-42de-8d6f-04f40937d6b5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.384057] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbd21bfd-b28c-42de-8d6f-04f40937d6b5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.384323] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbd21bfd-b28c-42de-8d6f-04f40937d6b5',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.882416] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.882416] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.882416] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.882416] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.882416] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.882416] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.882416] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.882416] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.882416] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.882416] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.882416] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e11ed3d-a638-4666-83ac-41d49f4f9874 is going to be updated. [ 711.890340] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cbd21bfd-b28c-42de-8d6f-04f40937d6b5 [ 711.892657] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.892657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.892657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.892657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.892657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.892657] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cbd21bfd-b28c-42de-8d6f-04f40937d6b5 already deleted. [ 711.892657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbd21bfd-b28c-42de-8d6f-04f40937d6b5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.937744] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.938604] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.938712] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.943749] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.943749] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.955673] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e11ed3d-a638-4666-83ac-41d49f4f9874 in Status: IN_PROGRESS for 2s [ 711.981823] env[70520]: INFO networking_nsxv3.common.synchronization [None req-e3f47401-b16d-49aa-b766-c3e4247025b8 tempest-ServerActionsTestOtherB-256435736 tempest-ServerActionsTestOtherB-256435736-project-member] Enqueued Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_rules [ 711.982570] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_rules [ 711.983142] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.983336] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.983442] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.983754] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.983865] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.398486] env[70520]: INFO networking_nsxv3.common.synchronization [None req-f19b2a8a-8937-47c3-b831-bd5690e84733 tempest-ServerActionsTestOtherB-256435736 tempest-ServerActionsTestOtherB-256435736-project-member] Enqueued Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_rules [ 712.399915] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_rules [ 712.400262] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.400364] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.460725] env[70520]: INFO networking_nsxv3.common.synchronization [req-33290a01-b5f9-4404-bd66-9e9a38e6a89e req-fd00186a-b468-4048-bcae-1b70ceea4756 tempest-DeleteServersAdminTestJSON-1819798580 tempest-DeleteServersAdminTestJSON-1819798580-project-admin] Enqueued Resource ID: e84213b0-a32e-49bf-97aa-67c24de8104c with Priority: HIGHEST for action security_group_members [ 712.461439] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84213b0-a32e-49bf-97aa-67c24de8104c with Priority: HIGHEST for action security_group_members [ 712.461961] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84213b0-a32e-49bf-97aa-67c24de8104c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.461961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.461961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.464838] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.465093] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.465310] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.465679] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.465876] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.465876] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.465969] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e84213b0-a32e-49bf-97aa-67c24de8104c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.513846] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.513846] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.514141] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.514949] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.514949] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.514949] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 already deleted. [ 712.514949] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.514949] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.515212] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.515212] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.919465] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc967d33-6d28-4dd5-98c4-22ac5cda2d2e in Status: SUCCESS [ 712.920272] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.970355] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.970355] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.970548] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.971098] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.971417] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.972844] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.973113] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.973113] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.973323] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.973405] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.973457] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84213b0-a32e-49bf-97aa-67c24de8104c is going to be updated. [ 713.003618] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.003796] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.003836] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.004045] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.004188] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.014094] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84213b0-a32e-49bf-97aa-67c24de8104c in Status: IN_PROGRESS for 2s [ 713.052089] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.052089] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.053669] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.053669] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.053669] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.053669] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 already deleted. [ 713.053669] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.080467] env[70520]: INFO networking_nsxv3.common.synchronization [req-27ea14ae-9fe9-46dc-9fbc-958cae4f93c5 req-071cb437-47cf-4679-8c57-a7d24a2ebe8f tempest-VolumesAssistedSnapshotsTest-545368338 tempest-VolumesAssistedSnapshotsTest-545368338-project-member] Enqueued Resource ID: e2732d4c-390c-4309-8596-f408bd1b4ecf with Priority: HIGHEST for action security_group_members [ 713.081035] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2732d4c-390c-4309-8596-f408bd1b4ecf with Priority: HIGHEST for action security_group_members [ 713.081346] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2732d4c-390c-4309-8596-f408bd1b4ecf taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.081477] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.081542] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.085226] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.085226] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.087318] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.087318] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.087318] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.087318] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.087318] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2732d4c-390c-4309-8596-f408bd1b4ecf',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.266429] env[70520]: INFO networking_nsxv3.common.synchronization [None req-74e65168-84e1-4df6-b0f0-c92f769743eb None None] Enqueued Resource ID: 6e285920-dda1-486d-b886-e4f53474de04 with Priority: HIGHEST for action port [ 713.269118] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e285920-dda1-486d-b886-e4f53474de04 with Priority: HIGHEST for action port [ 713.269846] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e285920-dda1-486d-b886-e4f53474de04 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.269981] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e285920-dda1-486d-b886-e4f53474de04" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.270070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e285920-dda1-486d-b886-e4f53474de04" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.270412] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e285920-dda1-486d-b886-e4f53474de04" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.270412] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e285920-dda1-486d-b886-e4f53474de04',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.542034] env[70520]: INFO networking_nsxv3.common.synchronization [req-b5f24eb1-449c-46b0-b1d1-9efb10eebc85 req-253dde79-1037-4d87-a599-b4c2b313d2cd tempest-ServerDiagnosticsTest-599789744 tempest-ServerDiagnosticsTest-599789744-project-member] Enqueued Resource ID: 65c0ca8f-175d-4fd9-9598-89112bfad470 with Priority: HIGHEST for action security_group_members [ 713.542694] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65c0ca8f-175d-4fd9-9598-89112bfad470 with Priority: HIGHEST for action security_group_members [ 713.543362] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-65c0ca8f-175d-4fd9-9598-89112bfad470 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.543498] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.543569] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.543770] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.543926] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.544051] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.544116] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.546350] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.546514] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.546649] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65c0ca8f-175d-4fd9-9598-89112bfad470',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.590618] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.590618] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.590618] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.590618] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.590618] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.590618] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.590618] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.590618] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.590618] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.590618] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.590618] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2732d4c-390c-4309-8596-f408bd1b4ecf already deleted. [ 713.590618] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.660748] env[70520]: INFO networking_nsxv3.common.synchronization [req-597e230b-a180-460b-81b3-7f5521a78f1e req-53b6de6e-528c-456a-915a-cae3bc85c689 tempest-TenantUsagesTestJSON-1841604470 tempest-TenantUsagesTestJSON-1841604470-project-member] Enqueued Resource ID: e7c44ea9-34f2-45bb-bf52-dd72b3513eda with Priority: HIGHEST for action security_group_members [ 713.662173] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c44ea9-34f2-45bb-bf52-dd72b3513eda with Priority: HIGHEST for action security_group_members [ 713.662600] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.662751] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.662838] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.663191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.663601] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.663743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.663837] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.664044] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.664152] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.664262] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7c44ea9-34f2-45bb-bf52-dd72b3513eda',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.773712] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6e285920-dda1-486d-b886-e4f53474de04 [ 713.775029] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.775029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.775029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.775029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.775029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.775469] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6e285920-dda1-486d-b886-e4f53474de04 already deleted. [ 713.775689] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e285920-dda1-486d-b886-e4f53474de04" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.969228] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e11ed3d-a638-4666-83ac-41d49f4f9874 in Status: SUCCESS [ 713.969228] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e11ed3d-a638-4666-83ac-41d49f4f9874 deletion is rescheduled due to dependency. [ 713.969228] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.053037] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.053037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.053037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.053037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.053037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.053037] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.053037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.053037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.053037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.053037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.053037] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65c0ca8f-175d-4fd9-9598-89112bfad470 is going to be updated. [ 714.098255] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.098396] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.098545] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.098675] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.098961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.108372] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.108372] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-844" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.108372] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-844" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.108372] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-844" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.108372] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.108372] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.108372] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.108372] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.108372] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.108372] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 714.108372] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 714.108372] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 714.108372] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 714.109215] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 714.109215] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 714.109215] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 714.109824] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65c0ca8f-175d-4fd9-9598-89112bfad470 in Status: IN_PROGRESS for 2s [ 714.134270] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 714.134778] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 714.135321] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 714.136040] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-844" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.136134] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-4f49c968-d5c6-40d2-a792-e81645ac849a taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.136501] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-4f49c968-d5c6-40d2-a792-e81645ac849a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.136640] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-4f49c968-d5c6-40d2-a792-e81645ac849a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.136966] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-4f49c968-d5c6-40d2-a792-e81645ac849a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.137280] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f49c968-d5c6-40d2-a792-e81645ac849a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.170555] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.170731] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.170790] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.171876] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.172084] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.172523] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.172619] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.172619] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.173081] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.173081] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.173081] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7c44ea9-34f2-45bb-bf52-dd72b3513eda is going to be updated. [ 714.238511] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.238704] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.238744] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.238957] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.239121] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.254510] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7c44ea9-34f2-45bb-bf52-dd72b3513eda in Status: IN_PROGRESS for 2s [ 714.418823] env[70520]: INFO networking_nsxv3.common.synchronization [None req-11068b43-8d3c-438f-8312-fa8a8886f4c0 None None] Enqueued Resource ID: 0001e5b1-c5cf-44bf-b3ba-fd5fffebc48d with Priority: HIGHEST for action port [ 714.421233] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0001e5b1-c5cf-44bf-b3ba-fd5fffebc48d with Priority: HIGHEST for action port [ 714.422770] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-0001e5b1-c5cf-44bf-b3ba-fd5fffebc48d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.422770] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0001e5b1-c5cf-44bf-b3ba-fd5fffebc48d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.422770] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0001e5b1-c5cf-44bf-b3ba-fd5fffebc48d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.422770] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0001e5b1-c5cf-44bf-b3ba-fd5fffebc48d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.422770] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0001e5b1-c5cf-44bf-b3ba-fd5fffebc48d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.641989] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.642358] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.642541] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.642812] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.643026] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.643224] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 4f49c968-d5c6-40d2-a792-e81645ac849a not found, creating... [ 714.643877] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.646389] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.646389] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.646389] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.646389] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.646389] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.646389] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.646389] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.646389] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.646389] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.646389] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 4f49c968-d5c6-40d2-a792-e81645ac849a is going to be created. [ 714.677948] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.678224] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.678495] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.678633] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.678904] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.681333] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-4f49c968-d5c6-40d2-a792-e81645ac849a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.825936] env[70520]: INFO networking_nsxv3.common.synchronization [None req-858b9794-e670-4363-8564-e9644ef48db3 tempest-ServersTestJSON-2073228387 tempest-ServersTestJSON-2073228387-project-member] Enqueued Resource ID: 49148979-263a-4c7a-a007-bfce9aaa037b with Priority: HIGHEST for action security_group_rules [ 714.828010] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49148979-263a-4c7a-a007-bfce9aaa037b with Priority: HIGHEST for action security_group_rules [ 714.831065] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49148979-263a-4c7a-a007-bfce9aaa037b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.833937] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.833937] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.833937] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.833937] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49148979-263a-4c7a-a007-bfce9aaa037b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.877040] env[70520]: INFO networking_nsxv3.common.synchronization [None req-9de92f96-cf39-4b11-bbb4-6301428d24ad None None] Enqueued Resource ID: 31acd03b-eaa8-40a8-bf05-6e82a3c69331 with Priority: HIGHEST for action port [ 714.877657] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31acd03b-eaa8-40a8-bf05-6e82a3c69331 with Priority: HIGHEST for action port [ 714.878159] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-31acd03b-eaa8-40a8-bf05-6e82a3c69331 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.878434] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31acd03b-eaa8-40a8-bf05-6e82a3c69331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.878601] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31acd03b-eaa8-40a8-bf05-6e82a3c69331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.879633] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31acd03b-eaa8-40a8-bf05-6e82a3c69331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.879633] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31acd03b-eaa8-40a8-bf05-6e82a3c69331',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.925964] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0001e5b1-c5cf-44bf-b3ba-fd5fffebc48d [ 714.926330] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.926409] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.926467] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.926714] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.926809] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.926968] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0001e5b1-c5cf-44bf-b3ba-fd5fffebc48d already deleted. [ 714.926968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0001e5b1-c5cf-44bf-b3ba-fd5fffebc48d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.998403] env[70520]: INFO networking_nsxv3.common.synchronization [None req-d7901a7c-0e4b-4ee0-8494-b601e196d49b tempest-ServersTestJSON-2073228387 tempest-ServersTestJSON-2073228387-project-member] Enqueued Resource ID: 49148979-263a-4c7a-a007-bfce9aaa037b with Priority: HIGHEST for action security_group_rules [ 714.998905] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49148979-263a-4c7a-a007-bfce9aaa037b with Priority: HIGHEST for action security_group_rules [ 714.999206] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49148979-263a-4c7a-a007-bfce9aaa037b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.999321] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.025310] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84213b0-a32e-49bf-97aa-67c24de8104c in Status: SUCCESS [ 715.025714] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84213b0-a32e-49bf-97aa-67c24de8104c deletion is rescheduled due to dependency. [ 715.025860] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.358106] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.358106] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.358106] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.358106] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.358106] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.358106] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49148979-263a-4c7a-a007-bfce9aaa037b already deleted. [ 715.358106] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.358106] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.358106] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.358106] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49148979-263a-4c7a-a007-bfce9aaa037b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.385066] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31acd03b-eaa8-40a8-bf05-6e82a3c69331 [ 715.385066] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.385066] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.385066] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.385066] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.385066] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.385066] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31acd03b-eaa8-40a8-bf05-6e82a3c69331 already deleted. [ 715.385066] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31acd03b-eaa8-40a8-bf05-6e82a3c69331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.880497] env[70520]: INFO networking_nsxv3.common.synchronization [req-4224238f-d453-42a1-938d-df1fa553a4e3 req-28df88cd-3f61-40d0-9dbf-b18f754f9997 tempest-ServersWithSpecificFlavorTestJSON-1288943951 tempest-ServersWithSpecificFlavorTestJSON-1288943951-project-member] Enqueued Resource ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee with Priority: HIGHEST for action security_group_members [ 715.881369] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee with Priority: HIGHEST for action security_group_members [ 715.886062] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-2449c3c4-f89c-449c-97e2-c22d5d72dbee taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.886062] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.886062] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.886062] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.886062] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.886062] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.886062] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.886062] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.886062] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.886062] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2449c3c4-f89c-449c-97e2-c22d5d72dbee',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.886871] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.886871] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.886982] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.887616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.887795] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.891024] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49148979-263a-4c7a-a007-bfce9aaa037b already deleted. [ 715.891024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.120655] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65c0ca8f-175d-4fd9-9598-89112bfad470 in Status: SUCCESS [ 716.120847] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65c0ca8f-175d-4fd9-9598-89112bfad470 deletion is rescheduled due to dependency. [ 716.121070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.142666] env[70520]: INFO networking_nsxv3.common.synchronization [req-27ea14ae-9fe9-46dc-9fbc-958cae4f93c5 req-1e4ce61e-eaea-4a87-b650-9b86dce799b0 service nova] Enqueued Resource ID: e2732d4c-390c-4309-8596-f408bd1b4ecf with Priority: HIGHEST for action security_group_rules [ 716.142904] env[70520]: INFO networking_nsxv3.common.synchronization [req-27ea14ae-9fe9-46dc-9fbc-958cae4f93c5 req-1e4ce61e-eaea-4a87-b650-9b86dce799b0 service nova] Enqueued Resource ID: e2732d4c-390c-4309-8596-f408bd1b4ecf with Priority: HIGHEST for action security_group_members [ 716.143093] env[70520]: INFO networking_nsxv3.common.synchronization [req-27ea14ae-9fe9-46dc-9fbc-958cae4f93c5 req-1e4ce61e-eaea-4a87-b650-9b86dce799b0 service nova] Enqueued Resource ID: 4f49c968-d5c6-40d2-a792-e81645ac849a with Priority: HIGHEST for action port [ 716.143633] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2732d4c-390c-4309-8596-f408bd1b4ecf with Priority: HIGHEST for action security_group_rules [ 716.143794] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2732d4c-390c-4309-8596-f408bd1b4ecf with Priority: HIGHEST for action security_group_members [ 716.144318] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f49c968-d5c6-40d2-a792-e81645ac849a with Priority: HIGHEST for action port [ 716.144318] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2732d4c-390c-4309-8596-f408bd1b4ecf taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.144318] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.144318] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.146843] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.146843] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2732d4c-390c-4309-8596-f408bd1b4ecf',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.146843] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2732d4c-390c-4309-8596-f408bd1b4ecf taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.146843] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.146843] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.146843] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.146843] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.146843] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.146843] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.146843] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.146843] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.146843] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2732d4c-390c-4309-8596-f408bd1b4ecf',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.147521] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f49c968-d5c6-40d2-a792-e81645ac849a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.147521] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f49c968-d5c6-40d2-a792-e81645ac849a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.147521] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f49c968-d5c6-40d2-a792-e81645ac849a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.147653] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f49c968-d5c6-40d2-a792-e81645ac849a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.147653] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f49c968-d5c6-40d2-a792-e81645ac849a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.267635] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7c44ea9-34f2-45bb-bf52-dd72b3513eda in Status: SUCCESS [ 716.267635] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7c44ea9-34f2-45bb-bf52-dd72b3513eda deletion is rescheduled due to dependency. [ 716.267635] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.391216] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.391216] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.391216] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.391765] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.391765] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.391765] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.391921] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.391957] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.395772] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.395913] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.396073] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee already deleted. [ 716.396199] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.510936] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-405 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.513035] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-405" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.513035] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-405" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.513035] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-405" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.513035] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.513035] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.513035] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.513035] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.513035] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.513035] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 716.513035] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 716.513754] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 716.513754] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 716.513754] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 716.513754] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 716.513754] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 716.536985] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 716.537253] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 716.537510] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 716.537933] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-405" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.538140] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-e4340211-ef59-4906-a49d-6fdbb08d3ef8 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.538888] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-e4340211-ef59-4906-a49d-6fdbb08d3ef8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.538888] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-e4340211-ef59-4906-a49d-6fdbb08d3ef8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.539032] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-e4340211-ef59-4906-a49d-6fdbb08d3ef8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.542937] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4340211-ef59-4906-a49d-6fdbb08d3ef8',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.652628] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2732d4c-390c-4309-8596-f408bd1b4ecf taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.652628] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.652628] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2732d4c-390c-4309-8596-f408bd1b4ecf',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.652628] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f49c968-d5c6-40d2-a792-e81645ac849a with status ACTIVE [ 716.652628] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.652628] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.652628] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.653346] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.653346] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.653346] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.653346] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.653346] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.653346] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.653346] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.653563] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.653609] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.653640] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.653809] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.653857] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.654070] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f49c968-d5c6-40d2-a792-e81645ac849a is going to be updated. [ 716.682051] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.682595] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.682595] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.682786] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.682952] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.683133] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f49c968-d5c6-40d2-a792-e81645ac849a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.046325] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.046869] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.046869] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.047434] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.047611] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.047787] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port e4340211-ef59-4906-a49d-6fdbb08d3ef8 not found, creating... [ 717.048111] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.048299] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.048436] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.048782] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.048943] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.050021] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.050445] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.050544] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.051188] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.051410] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.051599] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: e4340211-ef59-4906-a49d-6fdbb08d3ef8 is going to be created. [ 717.081363] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.081488] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.082030] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.082030] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.082388] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.084023] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-e4340211-ef59-4906-a49d-6fdbb08d3ef8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.157266] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2732d4c-390c-4309-8596-f408bd1b4ecf',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.387565] env[70520]: INFO networking_nsxv3.common.synchronization [None req-064bb73b-925c-47a5-8db8-e53a184ca12e None None] Enqueued Resource ID: de405163-76d2-4c1c-8bdd-3e60f4508153 with Priority: HIGHEST for action port [ 717.388086] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de405163-76d2-4c1c-8bdd-3e60f4508153 with Priority: HIGHEST for action port [ 717.388402] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-de405163-76d2-4c1c-8bdd-3e60f4508153 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.388525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de405163-76d2-4c1c-8bdd-3e60f4508153" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.388587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de405163-76d2-4c1c-8bdd-3e60f4508153" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.388832] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de405163-76d2-4c1c-8bdd-3e60f4508153" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.388908] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de405163-76d2-4c1c-8bdd-3e60f4508153',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.659656] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.659813] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.660592] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.660866] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.660985] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.661509] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2732d4c-390c-4309-8596-f408bd1b4ecf is going to be created. [ 717.689200] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.689355] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.689435] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.689646] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.689781] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.702986] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2732d4c-390c-4309-8596-f408bd1b4ecf in Status: UNINITIALIZED for 2s [ 717.873234] env[70520]: INFO networking_nsxv3.common.synchronization [None req-28cf6066-05f5-4a52-8ba5-40aed6e81132 None None] Enqueued Resource ID: 0adfd2b4-9f8b-468c-aabc-c0b32e35acdc with Priority: HIGHEST for action port [ 717.873711] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0adfd2b4-9f8b-468c-aabc-c0b32e35acdc with Priority: HIGHEST for action port [ 717.875083] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-0adfd2b4-9f8b-468c-aabc-c0b32e35acdc taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.875374] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0adfd2b4-9f8b-468c-aabc-c0b32e35acdc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.875644] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0adfd2b4-9f8b-468c-aabc-c0b32e35acdc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.876076] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0adfd2b4-9f8b-468c-aabc-c0b32e35acdc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.876202] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0adfd2b4-9f8b-468c-aabc-c0b32e35acdc',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.892646] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de405163-76d2-4c1c-8bdd-3e60f4508153 [ 717.892646] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.892646] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.892646] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.892646] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.892646] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.892646] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de405163-76d2-4c1c-8bdd-3e60f4508153 already deleted. [ 717.892646] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de405163-76d2-4c1c-8bdd-3e60f4508153" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.921382] env[70520]: INFO networking_nsxv3.common.synchronization [req-4224238f-d453-42a1-938d-df1fa553a4e3 req-f9223a2b-1516-44dc-bae2-d2d0efc3a7ee service nova] Enqueued Resource ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee with Priority: HIGHEST for action security_group_rules [ 717.921639] env[70520]: INFO networking_nsxv3.common.synchronization [req-4224238f-d453-42a1-938d-df1fa553a4e3 req-f9223a2b-1516-44dc-bae2-d2d0efc3a7ee service nova] Enqueued Resource ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee with Priority: HIGHEST for action security_group_members [ 717.921838] env[70520]: INFO networking_nsxv3.common.synchronization [req-4224238f-d453-42a1-938d-df1fa553a4e3 req-f9223a2b-1516-44dc-bae2-d2d0efc3a7ee service nova] Enqueued Resource ID: e4340211-ef59-4906-a49d-6fdbb08d3ef8 with Priority: HIGHEST for action port [ 717.922603] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee with Priority: HIGHEST for action security_group_rules [ 717.922777] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee with Priority: HIGHEST for action security_group_members [ 717.922908] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4340211-ef59-4906-a49d-6fdbb08d3ef8 with Priority: HIGHEST for action port [ 717.923280] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.923442] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.923539] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.923811] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.923931] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2449c3c4-f89c-449c-97e2-c22d5d72dbee',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.925090] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-2449c3c4-f89c-449c-97e2-c22d5d72dbee taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.925247] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.925339] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.926133] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.926133] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.926133] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.926133] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.926397] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.926397] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.926501] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2449c3c4-f89c-449c-97e2-c22d5d72dbee',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.928639] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4340211-ef59-4906-a49d-6fdbb08d3ef8 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.928639] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4340211-ef59-4906-a49d-6fdbb08d3ef8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.928639] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4340211-ef59-4906-a49d-6fdbb08d3ef8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.928639] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4340211-ef59-4906-a49d-6fdbb08d3ef8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.929074] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4340211-ef59-4906-a49d-6fdbb08d3ef8',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.379434] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0adfd2b4-9f8b-468c-aabc-c0b32e35acdc [ 718.379434] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.379434] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.379434] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.379434] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.379434] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.379936] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0adfd2b4-9f8b-468c-aabc-c0b32e35acdc already deleted. [ 718.379936] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0adfd2b4-9f8b-468c-aabc-c0b32e35acdc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.433905] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-2449c3c4-f89c-449c-97e2-c22d5d72dbee taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.433905] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.433905] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2449c3c4-f89c-449c-97e2-c22d5d72dbee',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.435261] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e4340211-ef59-4906-a49d-6fdbb08d3ef8 with status ACTIVE [ 718.435515] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.435659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.435725] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.435952] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.436047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.436219] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.436315] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.436386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.436566] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.436651] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.436891] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.436973] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.439983] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.440641] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.440641] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.440641] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e4340211-ef59-4906-a49d-6fdbb08d3ef8 is going to be updated. [ 718.463812] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.468193] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.468193] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.468193] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.468193] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.468193] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4340211-ef59-4906-a49d-6fdbb08d3ef8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.917776] env[70520]: INFO networking_nsxv3.common.synchronization [req-3a8e58e4-c26a-49fb-a6ca-5a1041cb5c28 req-994358fe-2806-4bc4-a4a7-f3aa1f8e759e tempest-DeleteServersTestJSON-1399047283 tempest-DeleteServersTestJSON-1399047283-project-member] Enqueued Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 718.918341] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 718.918695] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.918850] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.918917] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.919390] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.919584] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.920238] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.920396] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.921149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.921149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.921149] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.935699] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2449c3c4-f89c-449c-97e2-c22d5d72dbee',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.417302] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-493 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.417302] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-493" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.417302] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-493" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.417730] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-493" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.417730] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.417855] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.418142] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.418850] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.418850] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.418850] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 719.418850] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 719.419057] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 719.419161] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 719.419285] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 719.419409] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 719.419562] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 719.422763] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.422924] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.423031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.423171] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.423246] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.423428] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.423522] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.423600] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.423729] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.423803] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.423885] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f already deleted. [ 719.423963] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.439652] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.439863] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.440009] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.440304] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.440353] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.440500] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee is going to be created. [ 719.442378] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 719.442651] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 719.443541] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 719.443541] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-493" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.443541] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-38d2ebd8-d515-4615-9d0e-504ef313737a taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.443541] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-38d2ebd8-d515-4615-9d0e-504ef313737a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.443842] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-38d2ebd8-d515-4615-9d0e-504ef313737a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.444186] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-38d2ebd8-d515-4615-9d0e-504ef313737a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.444354] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38d2ebd8-d515-4615-9d0e-504ef313737a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.470794] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.471960] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.471960] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.471960] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.471960] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.491788] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee in Status: UNINITIALIZED for 2s [ 719.715295] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2732d4c-390c-4309-8596-f408bd1b4ecf in Status: SUCCESS [ 719.715295] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.715295] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.715295] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.715295] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.715295] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.715295] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.715295] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.715295] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.715295] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.715295] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2732d4c-390c-4309-8596-f408bd1b4ecf',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.948047] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.948406] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.948406] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.948913] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.948913] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.949087] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 38d2ebd8-d515-4615-9d0e-504ef313737a not found, creating... [ 719.949510] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.949510] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.949691] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.949887] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.950068] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.950385] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.950578] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.950718] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.950947] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.955210] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.955422] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 38d2ebd8-d515-4615-9d0e-504ef313737a is going to be created. [ 719.980628] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.980876] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.981019] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.981345] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.981604] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.981897] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-38d2ebd8-d515-4615-9d0e-504ef313737a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.219475] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2732d4c-390c-4309-8596-f408bd1b4ecf',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.258388] env[70520]: INFO networking_nsxv3.common.synchronization [None req-455f5d3d-d8d8-49d2-8790-46b2c02a15c2 None None] Enqueued Resource ID: c5c8659a-2224-41a3-a81a-3ab517741cea with Priority: HIGHEST for action port [ 720.258895] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c8659a-2224-41a3-a81a-3ab517741cea with Priority: HIGHEST for action port [ 720.259246] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5c8659a-2224-41a3-a81a-3ab517741cea taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.260244] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5c8659a-2224-41a3-a81a-3ab517741cea" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.260244] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5c8659a-2224-41a3-a81a-3ab517741cea" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.260244] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5c8659a-2224-41a3-a81a-3ab517741cea" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.260244] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5c8659a-2224-41a3-a81a-3ab517741cea',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.721769] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2732d4c-390c-4309-8596-f408bd1b4ecf: rpc.has_security_group_logging(os_id): False [ 720.745318] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.745483] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.745554] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.746594] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.746594] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.746594] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.746594] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.746594] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.747015] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.747015] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.747015] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2732d4c-390c-4309-8596-f408bd1b4ecf is going to be created. [ 720.764153] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5c8659a-2224-41a3-a81a-3ab517741cea [ 720.764153] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.764153] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.764350] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.764493] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.764682] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.764841] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5c8659a-2224-41a3-a81a-3ab517741cea already deleted. [ 720.764893] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5c8659a-2224-41a3-a81a-3ab517741cea" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.822670] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.822930] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.823010] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.823272] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.823532] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.837584] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2732d4c-390c-4309-8596-f408bd1b4ecf in Status: IN_PROGRESS for 2s [ 720.879665] env[70520]: INFO networking_nsxv3.common.synchronization [req-3a8e58e4-c26a-49fb-a6ca-5a1041cb5c28 req-8601824f-568e-408d-a78f-8edac2b195d8 service nova] Enqueued Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_rules [ 720.879665] env[70520]: INFO networking_nsxv3.common.synchronization [req-3a8e58e4-c26a-49fb-a6ca-5a1041cb5c28 req-8601824f-568e-408d-a78f-8edac2b195d8 service nova] Enqueued Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 720.879665] env[70520]: INFO networking_nsxv3.common.synchronization [req-3a8e58e4-c26a-49fb-a6ca-5a1041cb5c28 req-8601824f-568e-408d-a78f-8edac2b195d8 service nova] Enqueued Resource ID: 38d2ebd8-d515-4615-9d0e-504ef313737a with Priority: HIGHEST for action port [ 720.879900] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_rules [ 720.880062] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 720.880245] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38d2ebd8-d515-4615-9d0e-504ef313737a with Priority: HIGHEST for action port [ 720.880863] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.884457] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.884457] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.884596] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.884596] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.885560] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.885710] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.885814] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.885957] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.886127] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.886223] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.886724] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.886724] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.886724] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.886724] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.890977] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-38d2ebd8-d515-4615-9d0e-504ef313737a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.891116] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38d2ebd8-d515-4615-9d0e-504ef313737a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.891171] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38d2ebd8-d515-4615-9d0e-504ef313737a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.891345] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38d2ebd8-d515-4615-9d0e-504ef313737a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.891418] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38d2ebd8-d515-4615-9d0e-504ef313737a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.393302] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.399754] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.399754] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.399754] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38d2ebd8-d515-4615-9d0e-504ef313737a with status ACTIVE [ 721.399754] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.399754] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.399754] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.399754] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.399754] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.399754] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.399754] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.399754] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.399754] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.399754] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.399754] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.400702] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.400702] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.400702] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.400702] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.400702] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38d2ebd8-d515-4615-9d0e-504ef313737a is going to be updated. [ 721.423470] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.423470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.423470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.423470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.423470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.423470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38d2ebd8-d515-4615-9d0e-504ef313737a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.506542] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee in Status: SUCCESS [ 721.506542] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.506542] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.506542] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.506542] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.506542] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.506542] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.508232] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.508232] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.508232] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.508232] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2449c3c4-f89c-449c-97e2-c22d5d72dbee',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.902116] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.013492] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2449c3c4-f89c-449c-97e2-c22d5d72dbee',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.259331] env[70520]: INFO networking_nsxv3.common.synchronization [req-73d88785-8db6-4c27-970f-0c030965133b req-1b3b8fcf-7a6a-497f-9de1-7f7d7632438d tempest-ServerExternalEventsTest-548408651 tempest-ServerExternalEventsTest-548408651-project-member] Enqueued Resource ID: eea0e866-b3b3-48be-a8a8-74b9431668cb with Priority: HIGHEST for action security_group_members [ 722.260799] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eea0e866-b3b3-48be-a8a8-74b9431668cb with Priority: HIGHEST for action security_group_members [ 722.260799] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea0e866-b3b3-48be-a8a8-74b9431668cb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.260799] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.260799] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.261068] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.261068] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.262781] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.262781] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.262781] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.262781] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.262781] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eea0e866-b3b3-48be-a8a8-74b9431668cb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.405971] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.406220] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.406294] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.406512] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.406602] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.406705] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f is going to be created. [ 722.449396] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.449757] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.449757] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.449883] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.450017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.463655] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: UNINITIALIZED for 2s [ 722.516171] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2449c3c4-f89c-449c-97e2-c22d5d72dbee: rpc.has_security_group_logging(os_id): False [ 722.537047] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.537047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.537047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.537047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.537047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.537047] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.537047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.537047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.537047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.537047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.537047] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee is going to be created. [ 722.598908] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.599094] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.599170] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.599403] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.599609] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.625273] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee in Status: IN_PROGRESS for 2s [ 722.765535] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.765743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.765825] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.766033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.766116] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.766314] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.766420] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.766512] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.766936] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.766936] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.766936] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eea0e866-b3b3-48be-a8a8-74b9431668cb already deleted. [ 722.767092] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.845759] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-659 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.845987] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.846357] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.846701] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.847066] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.847266] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.847428] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.847710] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.847960] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.848141] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 722.848466] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 722.848623] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 722.848789] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 722.848945] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 722.849144] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 722.849424] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 722.863787] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2732d4c-390c-4309-8596-f408bd1b4ecf in Status: SUCCESS [ 722.863787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.871808] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 722.871983] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 722.872140] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 722.872318] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.872825] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-13296c6b-84b3-40b0-a4f5-e471117d2583 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.872961] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-13296c6b-84b3-40b0-a4f5-e471117d2583" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.873092] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-13296c6b-84b3-40b0-a4f5-e471117d2583" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.873790] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-13296c6b-84b3-40b0-a4f5-e471117d2583" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.873943] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13296c6b-84b3-40b0-a4f5-e471117d2583',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.377962] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.378320] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.378365] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.380073] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.380073] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.380073] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 13296c6b-84b3-40b0-a4f5-e471117d2583 not found, creating... [ 723.380073] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.380073] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.380073] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.380073] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.380073] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.381421] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.381421] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.381421] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.381421] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.381421] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.381421] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 13296c6b-84b3-40b0-a4f5-e471117d2583 is going to be created. [ 723.405221] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.405509] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.405800] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.405911] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.406146] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.406382] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-13296c6b-84b3-40b0-a4f5-e471117d2583" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.475347] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: SUCCESS [ 724.475652] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.475762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.476648] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.476946] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.477112] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.477176] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.477369] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.477462] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.477555] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.477648] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.640610] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee in Status: SUCCESS [ 724.640976] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.645211] env[70520]: INFO networking_nsxv3.common.synchronization [req-748c8594-935c-41c1-b567-42c5bd588b21 req-144b7c53-19a4-4662-b3a8-053b5fe03703 tempest-AttachInterfacesV270Test-531944994 tempest-AttachInterfacesV270Test-531944994-project-member] Enqueued Resource ID: 7be95060-a5a7-451a-a570-3386da846ca4 with Priority: HIGHEST for action security_group_members [ 724.645550] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7be95060-a5a7-451a-a570-3386da846ca4 with Priority: HIGHEST for action security_group_members [ 724.645870] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-7be95060-a5a7-451a-a570-3386da846ca4 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.645996] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7be95060-a5a7-451a-a570-3386da846ca4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.647029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7be95060-a5a7-451a-a570-3386da846ca4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.647029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7be95060-a5a7-451a-a570-3386da846ca4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.647170] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.647338] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.647338] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.647518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.647616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.647746] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7be95060-a5a7-451a-a570-3386da846ca4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.984172] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.984347] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.984389] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.984638] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.984810] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.984916] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.985022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.985150] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.985260] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.985323] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.985823] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.985823] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.985823] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.985823] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.985991] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.986067] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.986129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.986270] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.986341] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.986453] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.986721] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.095865] env[70520]: INFO networking_nsxv3.common.synchronization [req-73d88785-8db6-4c27-970f-0c030965133b req-68ec8ad5-77b9-4fb4-8396-029decc0bf37 service nova] Enqueued Resource ID: eea0e866-b3b3-48be-a8a8-74b9431668cb with Priority: HIGHEST for action security_group_rules [ 725.096066] env[70520]: INFO networking_nsxv3.common.synchronization [req-73d88785-8db6-4c27-970f-0c030965133b req-68ec8ad5-77b9-4fb4-8396-029decc0bf37 service nova] Enqueued Resource ID: eea0e866-b3b3-48be-a8a8-74b9431668cb with Priority: HIGHEST for action security_group_members [ 725.096210] env[70520]: INFO networking_nsxv3.common.synchronization [req-73d88785-8db6-4c27-970f-0c030965133b req-68ec8ad5-77b9-4fb4-8396-029decc0bf37 service nova] Enqueued Resource ID: 13296c6b-84b3-40b0-a4f5-e471117d2583 with Priority: HIGHEST for action port [ 725.096559] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eea0e866-b3b3-48be-a8a8-74b9431668cb with Priority: HIGHEST for action security_group_rules [ 725.096604] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eea0e866-b3b3-48be-a8a8-74b9431668cb with Priority: HIGHEST for action security_group_members [ 725.096680] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13296c6b-84b3-40b0-a4f5-e471117d2583 with Priority: HIGHEST for action port [ 725.100847] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eea0e866-b3b3-48be-a8a8-74b9431668cb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.100981] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.101070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.101367] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.101459] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eea0e866-b3b3-48be-a8a8-74b9431668cb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.102453] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea0e866-b3b3-48be-a8a8-74b9431668cb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.102658] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.102744] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.102995] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.106995] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.106995] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.106995] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.106995] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.106995] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.106995] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eea0e866-b3b3-48be-a8a8-74b9431668cb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.106995] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-13296c6b-84b3-40b0-a4f5-e471117d2583 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.106995] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13296c6b-84b3-40b0-a4f5-e471117d2583" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.106995] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13296c6b-84b3-40b0-a4f5-e471117d2583" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.106995] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13296c6b-84b3-40b0-a4f5-e471117d2583" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.106995] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13296c6b-84b3-40b0-a4f5-e471117d2583',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.115122] env[70520]: INFO networking_nsxv3.common.synchronization [req-e9663531-61cd-4100-8eae-1e8f6a25ec6f req-b792a315-fbb5-4e9d-8925-66be15a315cb tempest-ServerDiskConfigTestJSON-984450191 tempest-ServerDiskConfigTestJSON-984450191-project-member] Enqueued Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 725.118842] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 725.118842] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.118842] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.118842] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.118842] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.118842] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.118842] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.118842] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.119359] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.119359] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.119359] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.153819] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.153819] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.153819] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.153819] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.153819] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.153819] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.153819] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.153819] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.153819] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.153819] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.153819] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7be95060-a5a7-451a-a570-3386da846ca4 already deleted. [ 725.153819] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7be95060-a5a7-451a-a570-3386da846ca4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.488287] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 80751702-3cad-4ef3-af48-e8bd866c7e7f: rpc.has_security_group_logging(os_id): False [ 725.514567] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.514956] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.515266] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.515636] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.515810] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.516153] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.516605] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.516731] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.517032] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.517203] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.517454] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.517747] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.518276] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.518276] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.518476] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.518542] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.520023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.520023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.520023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.520023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.520023] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f is going to be created. [ 725.587884] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.587884] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.587884] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.588186] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.588268] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.600858] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: IN_PROGRESS for 2s [ 725.609083] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea0e866-b3b3-48be-a8a8-74b9431668cb taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.609083] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.612632] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eea0e866-b3b3-48be-a8a8-74b9431668cb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.614095] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 13296c6b-84b3-40b0-a4f5-e471117d2583 with status ACTIVE [ 725.614416] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.614811] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.614899] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.615187] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.615301] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.615516] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.615670] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.615719] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.615872] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.615954] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.616495] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.616711] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.616781] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.616987] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.617093] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.617198] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 13296c6b-84b3-40b0-a4f5-e471117d2583 is going to be updated. [ 725.623586] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.623757] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.623817] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.624030] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.624122] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.624330] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.624397] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.624456] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.624652] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.624752] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.624860] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 is going to be updated. [ 725.648604] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.648772] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.648847] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.649058] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.649435] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.649435] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13296c6b-84b3-40b0-a4f5-e471117d2583" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.661640] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-808 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.661903] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-808" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.662196] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-808" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.662819] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-808" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.662928] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.664948] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.664948] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.665086] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.665174] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.665399] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 725.665511] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 725.665622] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 725.665723] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 725.666177] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 725.666177] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 725.666177] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 725.698472] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.698645] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.698732] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.699320] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.699320] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.711371] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 725.711650] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.045 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 725.711780] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 725.712046] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-808" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.712639] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-32e37598-f4ba-4013-9f7c-458955b1123b taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.712895] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-32e37598-f4ba-4013-9f7c-458955b1123b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.713131] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-32e37598-f4ba-4013-9f7c-458955b1123b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.713531] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-32e37598-f4ba-4013-9f7c-458955b1123b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.713750] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32e37598-f4ba-4013-9f7c-458955b1123b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.717545] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: IN_PROGRESS for 2s [ 726.122654] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eea0e866-b3b3-48be-a8a8-74b9431668cb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.220448] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.220448] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.220598] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.221027] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.221027] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.221256] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 32e37598-f4ba-4013-9f7c-458955b1123b not found, creating... [ 726.222097] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.222097] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.222097] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.222097] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.222662] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.222662] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.223580] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.223580] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.223580] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.224257] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.224257] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 32e37598-f4ba-4013-9f7c-458955b1123b is going to be created. [ 726.249855] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.249855] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.250073] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.251474] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.251743] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.251978] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-32e37598-f4ba-4013-9f7c-458955b1123b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.625133] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.625476] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.625476] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.627442] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.627442] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.627442] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eea0e866-b3b3-48be-a8a8-74b9431668cb is going to be created. [ 726.679023] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.679023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.679023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.679023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.679023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.691824] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eea0e866-b3b3-48be-a8a8-74b9431668cb in Status: UNINITIALIZED for 2s [ 727.636739] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: SUCCESS [ 727.637135] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.727925] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: SUCCESS [ 727.727925] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 deletion is rescheduled due to dependency. [ 727.727925] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.293743] env[70520]: INFO networking_nsxv3.common.synchronization [None req-2c8837e9-a6c2-4bdf-913d-4ad773036c47 None None] Enqueued Resource ID: 96831bb9-03ce-49e3-9099-22bea7c412f8 with Priority: HIGHEST for action port [ 728.294527] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96831bb9-03ce-49e3-9099-22bea7c412f8 with Priority: HIGHEST for action port [ 728.294758] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-96831bb9-03ce-49e3-9099-22bea7c412f8 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.294890] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96831bb9-03ce-49e3-9099-22bea7c412f8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.294963] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96831bb9-03ce-49e3-9099-22bea7c412f8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.298358] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96831bb9-03ce-49e3-9099-22bea7c412f8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.298462] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96831bb9-03ce-49e3-9099-22bea7c412f8',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.414788] env[70520]: INFO networking_nsxv3.common.synchronization [req-748c8594-935c-41c1-b567-42c5bd588b21 req-943e92f3-9ceb-4f6e-bf69-b31ae5caee66 service nova] Enqueued Resource ID: 7be95060-a5a7-451a-a570-3386da846ca4 with Priority: HIGHEST for action security_group_rules [ 728.414788] env[70520]: INFO networking_nsxv3.common.synchronization [req-748c8594-935c-41c1-b567-42c5bd588b21 req-943e92f3-9ceb-4f6e-bf69-b31ae5caee66 service nova] Enqueued Resource ID: 7be95060-a5a7-451a-a570-3386da846ca4 with Priority: HIGHEST for action security_group_members [ 728.414907] env[70520]: INFO networking_nsxv3.common.synchronization [req-748c8594-935c-41c1-b567-42c5bd588b21 req-943e92f3-9ceb-4f6e-bf69-b31ae5caee66 service nova] Enqueued Resource ID: 32e37598-f4ba-4013-9f7c-458955b1123b with Priority: HIGHEST for action port [ 728.415174] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7be95060-a5a7-451a-a570-3386da846ca4 with Priority: HIGHEST for action security_group_rules [ 728.415295] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7be95060-a5a7-451a-a570-3386da846ca4 with Priority: HIGHEST for action security_group_members [ 728.415397] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32e37598-f4ba-4013-9f7c-458955b1123b with Priority: HIGHEST for action port [ 728.417773] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7be95060-a5a7-451a-a570-3386da846ca4 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.417773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7be95060-a5a7-451a-a570-3386da846ca4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.417773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7be95060-a5a7-451a-a570-3386da846ca4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.417773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7be95060-a5a7-451a-a570-3386da846ca4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.417773] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7be95060-a5a7-451a-a570-3386da846ca4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.418529] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-7be95060-a5a7-451a-a570-3386da846ca4 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.419967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7be95060-a5a7-451a-a570-3386da846ca4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.419967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7be95060-a5a7-451a-a570-3386da846ca4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.419967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7be95060-a5a7-451a-a570-3386da846ca4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.419967] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.419967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.419967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.419967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.419967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.419967] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7be95060-a5a7-451a-a570-3386da846ca4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.420570] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-32e37598-f4ba-4013-9f7c-458955b1123b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.420641] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32e37598-f4ba-4013-9f7c-458955b1123b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.420641] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32e37598-f4ba-4013-9f7c-458955b1123b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.420839] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32e37598-f4ba-4013-9f7c-458955b1123b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.420883] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32e37598-f4ba-4013-9f7c-458955b1123b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.704034] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eea0e866-b3b3-48be-a8a8-74b9431668cb in Status: SUCCESS [ 728.704310] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.704400] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.711540] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.711540] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.711540] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.711540] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.711540] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.711540] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.711540] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.711540] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eea0e866-b3b3-48be-a8a8-74b9431668cb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.801530] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 96831bb9-03ce-49e3-9099-22bea7c412f8 [ 728.801530] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.801530] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.801530] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.801530] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.801530] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.801530] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:96831bb9-03ce-49e3-9099-22bea7c412f8 already deleted. [ 728.801530] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96831bb9-03ce-49e3-9099-22bea7c412f8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.843274] env[70520]: INFO networking_nsxv3.common.synchronization [None req-69f3ed65-5f48-446c-8f67-d4f366ba4209 None None] Enqueued Resource ID: 4cf71ee7-db7b-408f-baad-d002291d2f2a with Priority: HIGHEST for action port [ 728.843274] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cf71ee7-db7b-408f-baad-d002291d2f2a with Priority: HIGHEST for action port [ 728.843274] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-4cf71ee7-db7b-408f-baad-d002291d2f2a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.843274] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4cf71ee7-db7b-408f-baad-d002291d2f2a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.843274] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4cf71ee7-db7b-408f-baad-d002291d2f2a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.843546] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4cf71ee7-db7b-408f-baad-d002291d2f2a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.843546] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cf71ee7-db7b-408f-baad-d002291d2f2a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.923468] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-7be95060-a5a7-451a-a570-3386da846ca4 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.923766] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7be95060-a5a7-451a-a570-3386da846ca4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.923766] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7be95060-a5a7-451a-a570-3386da846ca4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.924768] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32e37598-f4ba-4013-9f7c-458955b1123b with status ACTIVE [ 728.924851] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.924970] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.925035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.925274] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.925328] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.925474] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.925563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.925632] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.925845] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.925908] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.929684] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.929684] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.929684] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.929684] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.929965] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.929965] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32e37598-f4ba-4013-9f7c-458955b1123b is going to be updated. [ 728.954353] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.954507] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.954704] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.954914] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.955095] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.955363] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32e37598-f4ba-4013-9f7c-458955b1123b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.209076] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea0e866-b3b3-48be-a8a8-74b9431668cb taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.209343] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.209424] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.209695] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.209877] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.210020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.210134] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.210390] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.210479] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.210567] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.210740] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea0e866-b3b3-48be-a8a8-74b9431668cb taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.210836] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.210942] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.211120] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.212142] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.212142] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.212142] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.212142] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.212142] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.212142] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.212142] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eea0e866-b3b3-48be-a8a8-74b9431668cb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.349181] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4cf71ee7-db7b-408f-baad-d002291d2f2a [ 729.349181] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.349181] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.349181] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.349181] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.352117] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.352372] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4cf71ee7-db7b-408f-baad-d002291d2f2a already deleted. [ 729.353711] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4cf71ee7-db7b-408f-baad-d002291d2f2a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.432437] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7be95060-a5a7-451a-a570-3386da846ca4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.717130] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eea0e866-b3b3-48be-a8a8-74b9431668cb: rpc.has_security_group_logging(os_id): False [ 729.740725] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.740725] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.740725] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.741036] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.741036] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.741168] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.741244] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.741299] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.741466] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.742259] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.742259] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.742259] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.742259] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.742259] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.742781] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.744121] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.744286] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.745090] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.745090] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.745238] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.745407] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eea0e866-b3b3-48be-a8a8-74b9431668cb is going to be created. [ 729.831970] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.831970] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.831970] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.831970] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.831970] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.850385] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eea0e866-b3b3-48be-a8a8-74b9431668cb in Status: IN_PROGRESS for 2s [ 729.942744] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.942744] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.942744] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.942744] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.942744] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.942744] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7be95060-a5a7-451a-a570-3386da846ca4 is going to be created. [ 729.974254] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.974425] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.974473] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.974790] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.974948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.992033] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7be95060-a5a7-451a-a570-3386da846ca4 in Status: UNINITIALIZED for 2s [ 731.678912] env[70520]: INFO networking_nsxv3.common.synchronization [None req-96744161-3d4d-487b-8017-931f3dafae57 None None] Enqueued Resource ID: d26665aa-0fec-4416-bce7-d9810561e341 with Priority: HIGHEST for action port [ 731.678912] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d26665aa-0fec-4416-bce7-d9810561e341 with Priority: HIGHEST for action port [ 731.682024] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-d26665aa-0fec-4416-bce7-d9810561e341 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.682229] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d26665aa-0fec-4416-bce7-d9810561e341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.682303] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d26665aa-0fec-4416-bce7-d9810561e341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.682663] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d26665aa-0fec-4416-bce7-d9810561e341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.682757] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d26665aa-0fec-4416-bce7-d9810561e341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.866906] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eea0e866-b3b3-48be-a8a8-74b9431668cb in Status: SUCCESS [ 731.868158] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.003373] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7be95060-a5a7-451a-a570-3386da846ca4 in Status: SUCCESS [ 732.003568] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7be95060-a5a7-451a-a570-3386da846ca4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.003903] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7be95060-a5a7-451a-a570-3386da846ca4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.004509] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7be95060-a5a7-451a-a570-3386da846ca4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.005568] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.005842] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.005977] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.006233] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.006353] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.006474] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7be95060-a5a7-451a-a570-3386da846ca4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.006579] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7be95060-a5a7-451a-a570-3386da846ca4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.057903] env[70520]: INFO networking_nsxv3.common.synchronization [None req-2609d9ec-06a1-453c-917c-4d29f7484b2e None None] Enqueued Resource ID: c998fe71-bd8d-4fa2-8f27-9f56d909a9ed with Priority: HIGHEST for action port [ 732.060131] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c998fe71-bd8d-4fa2-8f27-9f56d909a9ed with Priority: HIGHEST for action port [ 732.060131] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-c998fe71-bd8d-4fa2-8f27-9f56d909a9ed taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.060131] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c998fe71-bd8d-4fa2-8f27-9f56d909a9ed" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.060131] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c998fe71-bd8d-4fa2-8f27-9f56d909a9ed" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.060906] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c998fe71-bd8d-4fa2-8f27-9f56d909a9ed" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.060906] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c998fe71-bd8d-4fa2-8f27-9f56d909a9ed',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.188087] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d26665aa-0fec-4416-bce7-d9810561e341 [ 732.188357] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.188492] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.188577] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.189090] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.189090] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.189090] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d26665aa-0fec-4416-bce7-d9810561e341 already deleted. [ 732.189090] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d26665aa-0fec-4416-bce7-d9810561e341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.511783] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-7be95060-a5a7-451a-a570-3386da846ca4 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.511783] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7be95060-a5a7-451a-a570-3386da846ca4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.511783] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7be95060-a5a7-451a-a570-3386da846ca4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.511783] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7be95060-a5a7-451a-a570-3386da846ca4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.511783] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.512074] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.512074] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.512140] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.512238] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.512350] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7be95060-a5a7-451a-a570-3386da846ca4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.512532] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-7be95060-a5a7-451a-a570-3386da846ca4 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.512679] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7be95060-a5a7-451a-a570-3386da846ca4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.512769] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7be95060-a5a7-451a-a570-3386da846ca4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.513049] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7be95060-a5a7-451a-a570-3386da846ca4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.513197] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.513310] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.513386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.513562] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.513661] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.513781] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7be95060-a5a7-451a-a570-3386da846ca4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.513879] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7be95060-a5a7-451a-a570-3386da846ca4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.563439] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c998fe71-bd8d-4fa2-8f27-9f56d909a9ed [ 732.563686] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.563826] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.563892] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.564123] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.564239] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.564296] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c998fe71-bd8d-4fa2-8f27-9f56d909a9ed already deleted. [ 732.565375] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c998fe71-bd8d-4fa2-8f27-9f56d909a9ed" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.016894] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7be95060-a5a7-451a-a570-3386da846ca4: rpc.has_security_group_logging(os_id): False [ 733.041202] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.041396] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.041664] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.041762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.041825] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.042189] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.042375] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.042439] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.042607] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.042727] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.042944] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.043058] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.043118] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.043266] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.043341] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.044151] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.044151] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.044291] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.044529] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.044529] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.044529] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7be95060-a5a7-451a-a570-3386da846ca4 is going to be created. [ 733.117588] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.117588] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.117588] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.117867] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.117979] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.129779] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7be95060-a5a7-451a-a570-3386da846ca4 in Status: IN_PROGRESS for 2s [ 733.510878] env[70520]: INFO networking_nsxv3.common.synchronization [req-58d08519-c5f7-432b-af63-3897a75f040f req-e99e3d90-dbfc-455f-b2a6-234da8714048 tempest-DeleteServersTestJSON-1399047283 tempest-DeleteServersTestJSON-1399047283-project-member] Enqueued Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 733.512464] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 733.513531] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.514514] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.514680] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.515955] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.515955] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.515955] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.515955] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.515955] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.515955] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.515955] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.021965] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.021965] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.021965] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.024759] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.024759] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.024759] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.024759] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.024759] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.024759] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.024759] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.024759] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f is going to be updated. [ 734.059019] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.059019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.059019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.059019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.059019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.069036] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: IN_PROGRESS for 2s [ 735.144694] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7be95060-a5a7-451a-a570-3386da846ca4 in Status: SUCCESS [ 735.144694] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7be95060-a5a7-451a-a570-3386da846ca4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.607225] env[70520]: INFO networking_nsxv3.common.synchronization [None req-db1ff48d-4810-44d4-96a6-5a95f26c7ee8 None None] Enqueued Resource ID: b7e0bda8-1e18-47c6-94f9-127a18052c00 with Priority: HIGHEST for action port [ 735.607480] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7e0bda8-1e18-47c6-94f9-127a18052c00 with Priority: HIGHEST for action port [ 735.608715] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7e0bda8-1e18-47c6-94f9-127a18052c00 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.609477] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7e0bda8-1e18-47c6-94f9-127a18052c00" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.611553] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7e0bda8-1e18-47c6-94f9-127a18052c00" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.611855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7e0bda8-1e18-47c6-94f9-127a18052c00" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.611973] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7e0bda8-1e18-47c6-94f9-127a18052c00',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.912093] env[70520]: INFO networking_nsxv3.common.synchronization [None req-e576d8f8-ab1c-491e-a766-626840774676 None None] Enqueued Resource ID: d9083f78-49e2-4358-930d-c80ddaefd7cb with Priority: HIGHEST for action port [ 735.912583] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9083f78-49e2-4358-930d-c80ddaefd7cb with Priority: HIGHEST for action port [ 735.913208] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9083f78-49e2-4358-930d-c80ddaefd7cb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.913208] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9083f78-49e2-4358-930d-c80ddaefd7cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.913208] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9083f78-49e2-4358-930d-c80ddaefd7cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.913442] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9083f78-49e2-4358-930d-c80ddaefd7cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.913442] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9083f78-49e2-4358-930d-c80ddaefd7cb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.080671] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: SUCCESS [ 736.080883] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f deletion is rescheduled due to dependency. [ 736.080883] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.115418] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b7e0bda8-1e18-47c6-94f9-127a18052c00 [ 736.115768] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.116414] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.116414] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.116414] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.116414] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.116690] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b7e0bda8-1e18-47c6-94f9-127a18052c00 already deleted. [ 736.116690] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7e0bda8-1e18-47c6-94f9-127a18052c00" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.417371] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d9083f78-49e2-4358-930d-c80ddaefd7cb [ 736.417371] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.417371] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.417371] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.417371] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.417371] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.417371] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d9083f78-49e2-4358-930d-c80ddaefd7cb already deleted. [ 736.417371] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9083f78-49e2-4358-930d-c80ddaefd7cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.582468] env[70520]: INFO networking_nsxv3.common.synchronization [None req-8b58bfff-c006-4e2e-8701-059b9c0ea8d7 None None] Enqueued Resource ID: 31310a0e-82f7-48a9-a4c3-95ecdcb512df with Priority: HIGHEST for action port [ 738.583145] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31310a0e-82f7-48a9-a4c3-95ecdcb512df with Priority: HIGHEST for action port [ 738.583448] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-31310a0e-82f7-48a9-a4c3-95ecdcb512df taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.583579] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31310a0e-82f7-48a9-a4c3-95ecdcb512df" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.583672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31310a0e-82f7-48a9-a4c3-95ecdcb512df" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.583996] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31310a0e-82f7-48a9-a4c3-95ecdcb512df" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.587329] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31310a0e-82f7-48a9-a4c3-95ecdcb512df',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.790797] env[70520]: INFO networking_nsxv3.common.synchronization [None req-1e50971f-5927-4da1-89b7-7957a6bbe529 None None] Enqueued Resource ID: e951f202-415f-4b8a-834d-a3950eee2943 with Priority: HIGHEST for action port [ 738.791088] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e951f202-415f-4b8a-834d-a3950eee2943 with Priority: HIGHEST for action port [ 738.792727] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-e951f202-415f-4b8a-834d-a3950eee2943 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.792727] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e951f202-415f-4b8a-834d-a3950eee2943" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.792727] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e951f202-415f-4b8a-834d-a3950eee2943" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.792727] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e951f202-415f-4b8a-834d-a3950eee2943" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.792727] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e951f202-415f-4b8a-834d-a3950eee2943',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.894922] env[70520]: INFO networking_nsxv3.common.synchronization [req-d8fc4104-eb9a-49f8-93a3-257efd68b6a7 req-eaadee47-57f1-4a13-8268-0b4e3ede4f48 tempest-ServerExternalEventsTest-548408651 tempest-ServerExternalEventsTest-548408651-project-member] Enqueued Resource ID: eea0e866-b3b3-48be-a8a8-74b9431668cb with Priority: HIGHEST for action security_group_members [ 738.895872] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eea0e866-b3b3-48be-a8a8-74b9431668cb with Priority: HIGHEST for action security_group_members [ 738.897062] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea0e866-b3b3-48be-a8a8-74b9431668cb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.897062] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.897062] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.897062] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.897062] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.897062] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.897062] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.897394] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.897394] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.897394] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eea0e866-b3b3-48be-a8a8-74b9431668cb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.089674] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31310a0e-82f7-48a9-a4c3-95ecdcb512df [ 739.089950] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.090088] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.090149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.090386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.090479] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.090584] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31310a0e-82f7-48a9-a4c3-95ecdcb512df already deleted. [ 739.090672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31310a0e-82f7-48a9-a4c3-95ecdcb512df" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.296122] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e951f202-415f-4b8a-834d-a3950eee2943 [ 739.296199] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.296833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.296833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.296833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.296833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.296833] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e951f202-415f-4b8a-834d-a3950eee2943 already deleted. [ 739.296833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e951f202-415f-4b8a-834d-a3950eee2943" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.401887] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.402074] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.402074] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.402238] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.402344] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.402514] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.402624] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.402675] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.403190] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.403190] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.403190] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eea0e866-b3b3-48be-a8a8-74b9431668cb is going to be updated. [ 739.441328] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.441547] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.441547] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.442065] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.442065] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.452969] env[70520]: INFO networking_nsxv3.common.synchronization [None req-b0a749ca-999d-40f6-bf7e-b76f09682e37 None None] Enqueued Resource ID: d0614639-9712-4c1c-b7de-3352f34425a1 with Priority: HIGHEST for action port [ 739.456575] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eea0e866-b3b3-48be-a8a8-74b9431668cb in Status: IN_PROGRESS for 2s [ 739.456575] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0614639-9712-4c1c-b7de-3352f34425a1 with Priority: HIGHEST for action port [ 739.456575] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0614639-9712-4c1c-b7de-3352f34425a1 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.456575] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0614639-9712-4c1c-b7de-3352f34425a1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.456575] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0614639-9712-4c1c-b7de-3352f34425a1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.456575] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0614639-9712-4c1c-b7de-3352f34425a1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.456575] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0614639-9712-4c1c-b7de-3352f34425a1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.957923] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0614639-9712-4c1c-b7de-3352f34425a1 [ 739.958459] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.958459] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.958459] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.958612] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.958763] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.958864] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0614639-9712-4c1c-b7de-3352f34425a1 already deleted. [ 739.958923] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0614639-9712-4c1c-b7de-3352f34425a1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.859412] env[70520]: INFO networking_nsxv3.common.synchronization [None req-84c73271-3767-439e-a9f8-1ee95b7aee34 None None] Enqueued Resource ID: 640a5f74-6a83-4a4e-96b0-60f47027713e with Priority: HIGHEST for action port [ 740.861125] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 640a5f74-6a83-4a4e-96b0-60f47027713e with Priority: HIGHEST for action port [ 740.861239] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-640a5f74-6a83-4a4e-96b0-60f47027713e taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.861793] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-640a5f74-6a83-4a4e-96b0-60f47027713e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.861908] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-640a5f74-6a83-4a4e-96b0-60f47027713e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.862306] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-640a5f74-6a83-4a4e-96b0-60f47027713e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.863556] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('640a5f74-6a83-4a4e-96b0-60f47027713e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.955304] env[70520]: INFO networking_nsxv3.common.synchronization [req-c02fc893-c302-4238-bcdf-a07b81f7ef86 req-37892ddc-4960-4ddc-a66f-1bc6eee7e384 tempest-ListServersNegativeTestJSON-1140309429 tempest-ListServersNegativeTestJSON-1140309429-project-member] Enqueued Resource ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 with Priority: HIGHEST for action security_group_members [ 740.955507] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 with Priority: HIGHEST for action security_group_members [ 740.955873] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.955984] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.956364] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.956364] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.956512] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.956618] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.956681] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.956855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.956948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.957044] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.366917] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 640a5f74-6a83-4a4e-96b0-60f47027713e [ 741.367263] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.367263] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.367364] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.367546] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.367607] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.367654] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:640a5f74-6a83-4a4e-96b0-60f47027713e already deleted. [ 741.367890] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-640a5f74-6a83-4a4e-96b0-60f47027713e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.460257] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.460257] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.460257] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.460257] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.460257] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.460614] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.460614] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.460614] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.460828] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.460828] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.460960] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 already deleted. [ 741.460960] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.465278] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eea0e866-b3b3-48be-a8a8-74b9431668cb in Status: SUCCESS [ 741.465743] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eea0e866-b3b3-48be-a8a8-74b9431668cb deletion is rescheduled due to dependency. [ 741.465743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.568710] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-82 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.568909] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.569040] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.569376] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.569638] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.569993] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.569993] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.570235] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.570414] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.570653] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 741.570793] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 741.571028] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 741.571101] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 741.571189] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 741.571310] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 741.571477] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 741.591268] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 741.591449] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 741.591589] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 741.591773] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.592106] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-c6a79693-0503-4218-8e85-4129fdfd82ad taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.592283] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-c6a79693-0503-4218-8e85-4129fdfd82ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.592452] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-c6a79693-0503-4218-8e85-4129fdfd82ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.592724] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-c6a79693-0503-4218-8e85-4129fdfd82ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.592865] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6a79693-0503-4218-8e85-4129fdfd82ad',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.670776] env[70520]: INFO networking_nsxv3.common.synchronization [None req-d17d4255-1fe3-48c5-befe-919b7ff5e13b None None] Enqueued Resource ID: efeaae00-a1fa-40c8-9463-add2abb0a44a with Priority: HIGHEST for action port [ 741.670776] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efeaae00-a1fa-40c8-9463-add2abb0a44a with Priority: HIGHEST for action port [ 741.671201] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-efeaae00-a1fa-40c8-9463-add2abb0a44a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.671525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-efeaae00-a1fa-40c8-9463-add2abb0a44a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.671602] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-efeaae00-a1fa-40c8-9463-add2abb0a44a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.671848] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-efeaae00-a1fa-40c8-9463-add2abb0a44a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.671932] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efeaae00-a1fa-40c8-9463-add2abb0a44a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.095255] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.095464] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.095583] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.095955] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.096078] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.096232] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port c6a79693-0503-4218-8e85-4129fdfd82ad not found, creating... [ 742.097118] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.097118] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.097118] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.097118] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.097118] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.097353] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.097517] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.097607] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.098116] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.098907] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.098907] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: c6a79693-0503-4218-8e85-4129fdfd82ad is going to be created. [ 742.118683] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.118906] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.119045] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.119346] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.119616] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.119846] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-c6a79693-0503-4218-8e85-4129fdfd82ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.179445] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port efeaae00-a1fa-40c8-9463-add2abb0a44a [ 742.181255] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.181255] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.181255] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.181255] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.181255] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.181255] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:efeaae00-a1fa-40c8-9463-add2abb0a44a already deleted. [ 742.181255] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-efeaae00-a1fa-40c8-9463-add2abb0a44a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.158244] env[70520]: INFO networking_nsxv3.common.synchronization [req-c02fc893-c302-4238-bcdf-a07b81f7ef86 req-b67bfbd3-90f4-4c12-9e8d-64ff40b04073 service nova] Enqueued Resource ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 with Priority: HIGHEST for action security_group_rules [ 743.158244] env[70520]: INFO networking_nsxv3.common.synchronization [req-c02fc893-c302-4238-bcdf-a07b81f7ef86 req-b67bfbd3-90f4-4c12-9e8d-64ff40b04073 service nova] Enqueued Resource ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 with Priority: HIGHEST for action security_group_members [ 743.158244] env[70520]: INFO networking_nsxv3.common.synchronization [req-c02fc893-c302-4238-bcdf-a07b81f7ef86 req-b67bfbd3-90f4-4c12-9e8d-64ff40b04073 service nova] Enqueued Resource ID: c6a79693-0503-4218-8e85-4129fdfd82ad with Priority: HIGHEST for action port [ 743.158244] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 with Priority: HIGHEST for action security_group_rules [ 743.158244] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 with Priority: HIGHEST for action security_group_members [ 743.158244] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a79693-0503-4218-8e85-4129fdfd82ad with Priority: HIGHEST for action port [ 743.158244] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.158244] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.160250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.160817] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.161766] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.163210] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.163458] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.163691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.163971] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.164250] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.164671] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.165150] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.165684] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.165684] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.167026] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.167026] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6a79693-0503-4218-8e85-4129fdfd82ad taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.167026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6a79693-0503-4218-8e85-4129fdfd82ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.167026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6a79693-0503-4218-8e85-4129fdfd82ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.167668] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6a79693-0503-4218-8e85-4129fdfd82ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.167940] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6a79693-0503-4218-8e85-4129fdfd82ad',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.318657] env[70520]: INFO networking_nsxv3.common.synchronization [req-c02fc893-c302-4238-bcdf-a07b81f7ef86 req-c0da1e08-d4b4-4fb5-a3d5-1a5b8398e882 tempest-ListServersNegativeTestJSON-1140309429 tempest-ListServersNegativeTestJSON-1140309429-project-member] Enqueued Resource ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 with Priority: HIGHEST for action security_group_members [ 743.319203] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 with Priority: HIGHEST for action security_group_members [ 743.319503] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.319698] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.453465] env[70520]: INFO networking_nsxv3.common.synchronization [None req-7f7baa31-310e-4be1-ad27-73ffa8489335 None None] Enqueued Resource ID: 5f96f6ee-ac2a-49f2-953e-8da257f1edd1 with Priority: HIGHEST for action port [ 743.453465] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f96f6ee-ac2a-49f2-953e-8da257f1edd1 with Priority: HIGHEST for action port [ 743.453465] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f96f6ee-ac2a-49f2-953e-8da257f1edd1 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.453465] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f96f6ee-ac2a-49f2-953e-8da257f1edd1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.453465] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f96f6ee-ac2a-49f2-953e-8da257f1edd1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.453465] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f96f6ee-ac2a-49f2-953e-8da257f1edd1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.453465] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f96f6ee-ac2a-49f2-953e-8da257f1edd1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.670168] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.670424] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.670696] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.673105] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6a79693-0503-4218-8e85-4129fdfd82ad with status ACTIVE [ 743.673615] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.673894] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.674027] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.674416] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.674818] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.675075] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.677422] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.677422] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.677544] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.677544] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.677732] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.677840] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.677953] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.678100] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.678137] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.678202] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6a79693-0503-4218-8e85-4129fdfd82ad is going to be updated. [ 743.700962] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.701127] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.701398] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.701487] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.701637] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.701807] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6a79693-0503-4218-8e85-4129fdfd82ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.743881] env[70520]: INFO networking_nsxv3.common.synchronization [None req-ffaef2ee-f36c-4e16-8fbd-6b4370d60dcf None None] Enqueued Resource ID: a08a4da3-5d80-4063-991f-e154b0ab6be6 with Priority: HIGHEST for action port [ 743.743881] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a08a4da3-5d80-4063-991f-e154b0ab6be6 with Priority: HIGHEST for action port [ 743.743881] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-a08a4da3-5d80-4063-991f-e154b0ab6be6 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.743881] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a08a4da3-5d80-4063-991f-e154b0ab6be6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.743881] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a08a4da3-5d80-4063-991f-e154b0ab6be6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.744836] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a08a4da3-5d80-4063-991f-e154b0ab6be6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.745117] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a08a4da3-5d80-4063-991f-e154b0ab6be6',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.959734] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f96f6ee-ac2a-49f2-953e-8da257f1edd1 [ 743.959975] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.960133] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.960223] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.960406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.960493] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.960632] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f96f6ee-ac2a-49f2-953e-8da257f1edd1 already deleted. [ 743.960681] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f96f6ee-ac2a-49f2-953e-8da257f1edd1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.990788] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-82 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.991326] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.991326] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.991518] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.991903] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.991903] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.992048] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.993185] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.993348] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.994186] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 743.994186] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 743.994186] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 743.994186] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 743.994186] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 743.994186] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 743.995525] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 744.017018] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 744.017018] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 744.017018] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 744.017018] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.017018] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-0367136a-8687-40f9-9c9f-6b48731e48e7 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.017018] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-0367136a-8687-40f9-9c9f-6b48731e48e7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.017018] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-0367136a-8687-40f9-9c9f-6b48731e48e7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.017018] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-0367136a-8687-40f9-9c9f-6b48731e48e7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.017018] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0367136a-8687-40f9-9c9f-6b48731e48e7',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.173431] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.251394] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a08a4da3-5d80-4063-991f-e154b0ab6be6 [ 744.251612] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.251745] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.251822] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.252037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.252120] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.252209] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a08a4da3-5d80-4063-991f-e154b0ab6be6 already deleted. [ 744.253755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a08a4da3-5d80-4063-991f-e154b0ab6be6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.518804] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.518993] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.519218] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.519389] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.519527] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.519733] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 0367136a-8687-40f9-9c9f-6b48731e48e7 not found, creating... [ 744.519951] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.520118] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.520398] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.520468] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.520568] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.520845] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.521114] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.525924] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.525924] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.525924] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.526524] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 0367136a-8687-40f9-9c9f-6b48731e48e7 is going to be created. [ 744.551832] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.551832] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.551832] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.551832] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.551832] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.551832] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-0367136a-8687-40f9-9c9f-6b48731e48e7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.680020] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.680020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.680020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.680020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.680020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.680020] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 is going to be created. [ 744.685960] env[70520]: INFO networking_nsxv3.common.synchronization [None req-717671a5-1a5f-4b5f-b276-40e3f44ccd2e None None] Enqueued Resource ID: 943be7a9-cf32-44b1-920b-f5e5cb09e4f5 with Priority: HIGHEST for action port [ 744.686604] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 943be7a9-cf32-44b1-920b-f5e5cb09e4f5 with Priority: HIGHEST for action port [ 744.686856] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-943be7a9-cf32-44b1-920b-f5e5cb09e4f5 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.686980] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-943be7a9-cf32-44b1-920b-f5e5cb09e4f5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.687053] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-943be7a9-cf32-44b1-920b-f5e5cb09e4f5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.687328] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-943be7a9-cf32-44b1-920b-f5e5cb09e4f5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.687409] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('943be7a9-cf32-44b1-920b-f5e5cb09e4f5',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.711528] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.711668] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.711733] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.711943] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.712152] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.729794] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 in Status: UNINITIALIZED for 2s [ 745.190246] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 943be7a9-cf32-44b1-920b-f5e5cb09e4f5 [ 745.190572] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.190642] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.190691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.190905] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.190978] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.191087] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:943be7a9-cf32-44b1-920b-f5e5cb09e4f5 already deleted. [ 745.191168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-943be7a9-cf32-44b1-920b-f5e5cb09e4f5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.426268] env[70520]: INFO networking_nsxv3.common.synchronization [req-c02fc893-c302-4238-bcdf-a07b81f7ef86 req-9c5b709b-0f2f-4006-98e1-946449ef4551 service nova] Enqueued Resource ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 with Priority: HIGHEST for action security_group_rules [ 745.426268] env[70520]: INFO networking_nsxv3.common.synchronization [req-c02fc893-c302-4238-bcdf-a07b81f7ef86 req-9c5b709b-0f2f-4006-98e1-946449ef4551 service nova] Enqueued Resource ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 with Priority: HIGHEST for action security_group_members [ 745.426369] env[70520]: INFO networking_nsxv3.common.synchronization [req-c02fc893-c302-4238-bcdf-a07b81f7ef86 req-9c5b709b-0f2f-4006-98e1-946449ef4551 service nova] Enqueued Resource ID: 0367136a-8687-40f9-9c9f-6b48731e48e7 with Priority: HIGHEST for action port [ 745.426569] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 with Priority: HIGHEST for action security_group_rules [ 745.426688] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 with Priority: HIGHEST for action security_group_members [ 745.426786] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0367136a-8687-40f9-9c9f-6b48731e48e7 with Priority: HIGHEST for action port [ 745.427343] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.427476] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.427639] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.427707] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.427852] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-0367136a-8687-40f9-9c9f-6b48731e48e7 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.427955] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0367136a-8687-40f9-9c9f-6b48731e48e7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.428039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0367136a-8687-40f9-9c9f-6b48731e48e7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.430062] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0367136a-8687-40f9-9c9f-6b48731e48e7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.430133] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0367136a-8687-40f9-9c9f-6b48731e48e7',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.669795] env[70520]: INFO networking_nsxv3.common.synchronization [None req-443d6b1f-2bfd-4b13-99ab-57469c6e8c9e None None] Enqueued Resource ID: 84896e89-60a1-4e3a-9786-348a27432d6a with Priority: HIGHEST for action port [ 745.670069] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84896e89-60a1-4e3a-9786-348a27432d6a with Priority: HIGHEST for action port [ 745.671280] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-84896e89-60a1-4e3a-9786-348a27432d6a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.671280] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84896e89-60a1-4e3a-9786-348a27432d6a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.671280] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84896e89-60a1-4e3a-9786-348a27432d6a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.671818] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84896e89-60a1-4e3a-9786-348a27432d6a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.671818] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84896e89-60a1-4e3a-9786-348a27432d6a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.800535] env[70520]: INFO networking_nsxv3.common.synchronization [req-c02fc893-c302-4238-bcdf-a07b81f7ef86 req-34c38b9c-16bb-4d2f-bc15-f54b69ea6022 tempest-ListServersNegativeTestJSON-1140309429 tempest-ListServersNegativeTestJSON-1140309429-project-member] Enqueued Resource ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 with Priority: HIGHEST for action security_group_members [ 745.801415] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 with Priority: HIGHEST for action security_group_members [ 745.802737] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.802737] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.875312] env[70520]: INFO networking_nsxv3.common.synchronization [req-726e38cf-1f25-4075-bf5c-16cfb375b938 req-a532a4d5-581a-4c00-8482-080a184145a9 tempest-AttachInterfacesV270Test-531944994 tempest-AttachInterfacesV270Test-531944994-project-member] Enqueued Resource ID: 7be95060-a5a7-451a-a570-3386da846ca4 with Priority: HIGHEST for action security_group_members [ 745.876730] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7be95060-a5a7-451a-a570-3386da846ca4 with Priority: HIGHEST for action security_group_members [ 745.877256] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-7be95060-a5a7-451a-a570-3386da846ca4 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.877561] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7be95060-a5a7-451a-a570-3386da846ca4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.877747] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7be95060-a5a7-451a-a570-3386da846ca4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.879634] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7be95060-a5a7-451a-a570-3386da846ca4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.880999] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.880999] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.880999] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.880999] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.880999] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.880999] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7be95060-a5a7-451a-a570-3386da846ca4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.934992] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0367136a-8687-40f9-9c9f-6b48731e48e7 with status ACTIVE [ 745.935721] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.935721] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.935721] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.935721] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.935721] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.935984] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.935984] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.936078] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.936182] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.936254] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.936481] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.936534] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.936569] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.937467] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.937467] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.937467] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0367136a-8687-40f9-9c9f-6b48731e48e7 is going to be updated. [ 745.959647] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.960326] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.960326] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.960547] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.960547] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.960782] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0367136a-8687-40f9-9c9f-6b48731e48e7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.175175] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 84896e89-60a1-4e3a-9786-348a27432d6a [ 746.175405] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.175688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.175688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.175939] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.176053] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.176155] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:84896e89-60a1-4e3a-9786-348a27432d6a already deleted. [ 746.176239] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84896e89-60a1-4e3a-9786-348a27432d6a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.208017] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-82 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.208285] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.208384] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.208651] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.208841] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.208996] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.209235] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.209491] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.209672] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.209936] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 746.210090] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 746.211139] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 746.214193] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 746.214193] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 746.214193] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 746.214193] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 746.235031] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 746.235031] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 746.235031] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 746.235031] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.235031] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-c8c43eff-195e-4bce-a04b-294e96ef0552 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.235031] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-c8c43eff-195e-4bce-a04b-294e96ef0552" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.235031] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-c8c43eff-195e-4bce-a04b-294e96ef0552" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.235031] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-c8c43eff-195e-4bce-a04b-294e96ef0552" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.235031] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8c43eff-195e-4bce-a04b-294e96ef0552',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.384606] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.384723] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.384849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.385081] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.385180] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.385650] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.385650] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.385650] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.385650] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.385865] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.385865] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7be95060-a5a7-451a-a570-3386da846ca4 is going to be updated. [ 746.413210] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.413359] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.413431] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.413632] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.413768] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.423067] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7be95060-a5a7-451a-a570-3386da846ca4 in Status: IN_PROGRESS for 2s [ 746.738259] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.739644] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.739644] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.740080] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.740080] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.740080] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port c8c43eff-195e-4bce-a04b-294e96ef0552 not found, creating... [ 746.740291] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.740478] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.740571] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.740798] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.740934] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.741235] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.741392] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.741504] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.741713] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.741846] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.741984] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: c8c43eff-195e-4bce-a04b-294e96ef0552 is going to be created. [ 746.743648] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 in Status: SUCCESS [ 746.744256] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.744256] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.744256] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.744474] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.744474] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.744474] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.744585] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.744667] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.745934] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.769439] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.769794] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.769794] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.770098] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.770337] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.770566] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-c8c43eff-195e-4bce-a04b-294e96ef0552" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.248195] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.579793] env[70520]: INFO networking_nsxv3.common.synchronization [req-c02fc893-c302-4238-bcdf-a07b81f7ef86 req-fc9a4809-d043-4e00-b71c-67a983356e28 service nova] Enqueued Resource ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 with Priority: HIGHEST for action security_group_rules [ 747.579906] env[70520]: INFO networking_nsxv3.common.synchronization [req-c02fc893-c302-4238-bcdf-a07b81f7ef86 req-fc9a4809-d043-4e00-b71c-67a983356e28 service nova] Enqueued Resource ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 with Priority: HIGHEST for action security_group_members [ 747.580150] env[70520]: INFO networking_nsxv3.common.synchronization [req-c02fc893-c302-4238-bcdf-a07b81f7ef86 req-fc9a4809-d043-4e00-b71c-67a983356e28 service nova] Enqueued Resource ID: c8c43eff-195e-4bce-a04b-294e96ef0552 with Priority: HIGHEST for action port [ 747.580461] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 with Priority: HIGHEST for action security_group_rules [ 747.580665] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 with Priority: HIGHEST for action security_group_members [ 747.581353] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8c43eff-195e-4bce-a04b-294e96ef0552 with Priority: HIGHEST for action port [ 747.582598] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.582598] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.582598] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.582598] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.582598] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8c43eff-195e-4bce-a04b-294e96ef0552 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.582598] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8c43eff-195e-4bce-a04b-294e96ef0552" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.582598] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8c43eff-195e-4bce-a04b-294e96ef0552" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.583402] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8c43eff-195e-4bce-a04b-294e96ef0552" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.583522] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8c43eff-195e-4bce-a04b-294e96ef0552',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.753318] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.851882] env[70520]: INFO networking_nsxv3.common.synchronization [None req-8e8411c3-a0b7-4228-84c2-ad4a919b1a45 None None] Enqueued Resource ID: 30c60495-b6aa-46e5-8f54-f3b2a28721b6 with Priority: HIGHEST for action port [ 747.852187] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30c60495-b6aa-46e5-8f54-f3b2a28721b6 with Priority: HIGHEST for action port [ 747.852759] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-30c60495-b6aa-46e5-8f54-f3b2a28721b6 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.853245] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30c60495-b6aa-46e5-8f54-f3b2a28721b6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.853317] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30c60495-b6aa-46e5-8f54-f3b2a28721b6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.853643] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30c60495-b6aa-46e5-8f54-f3b2a28721b6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.853803] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30c60495-b6aa-46e5-8f54-f3b2a28721b6',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.086741] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c8c43eff-195e-4bce-a04b-294e96ef0552 with status ACTIVE [ 748.086991] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.087209] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.087292] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.087503] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.087592] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.087760] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.087859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.087915] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.088140] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.088223] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.088421] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.088586] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.088586] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.088796] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.088796] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.088992] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c8c43eff-195e-4bce-a04b-294e96ef0552 is going to be updated. [ 748.112532] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.112970] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.112970] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.113196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.113627] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.113627] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8c43eff-195e-4bce-a04b-294e96ef0552" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.255956] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.256359] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.256359] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.256432] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.256538] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.256605] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 is going to be updated. [ 748.289301] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.289626] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.289742] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.290495] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.290670] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.301896] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 in Status: IN_PROGRESS for 2s [ 748.357546] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30c60495-b6aa-46e5-8f54-f3b2a28721b6 [ 748.357790] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.357933] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.358010] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.358233] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.358321] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.358417] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30c60495-b6aa-46e5-8f54-f3b2a28721b6 already deleted. [ 748.358496] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30c60495-b6aa-46e5-8f54-f3b2a28721b6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.433804] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7be95060-a5a7-451a-a570-3386da846ca4 in Status: SUCCESS [ 748.433953] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7be95060-a5a7-451a-a570-3386da846ca4 deletion is rescheduled due to dependency. [ 748.436513] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7be95060-a5a7-451a-a570-3386da846ca4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.811259] env[70520]: INFO networking_nsxv3.common.synchronization [req-c25c03e2-664d-4789-bc0f-26b581e3c346 req-6f1586a0-6267-4478-838c-0ad81a630be0 tempest-FloatingIPsAssociationTestJSON-847223640 tempest-FloatingIPsAssociationTestJSON-847223640-project-member] Enqueued Resource ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 with Priority: HIGHEST for action security_group_members [ 749.818023] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 with Priority: HIGHEST for action security_group_members [ 749.818023] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-22824640-0730-4b9a-a9ef-9014ef216bc4 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.818023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.818023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.818023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.818023] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.818023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.818023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.818023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.818023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.818023] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22824640-0730-4b9a-a9ef-9014ef216bc4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.209666] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-67 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.209861] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-67" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.209861] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-67" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.210282] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-67" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.210516] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.210655] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.210935] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.210935] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.211081] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.211246] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 750.211356] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 750.211461] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 750.211567] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 750.211854] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 750.211854] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 750.211995] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 750.235300] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 750.235300] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 750.235300] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 750.235300] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-67" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.235300] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-7241fe7b-7604-4533-b717-e262b257427d taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.235300] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-7241fe7b-7604-4533-b717-e262b257427d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.235300] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-7241fe7b-7604-4533-b717-e262b257427d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.235300] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-7241fe7b-7604-4533-b717-e262b257427d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.236748] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7241fe7b-7604-4533-b717-e262b257427d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.312827] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 in Status: SUCCESS [ 750.313918] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.313918] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.313918] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.313918] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.313918] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.313918] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.314247] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.314247] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.314247] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.314247] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.315410] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.315605] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.315848] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.317053] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.317053] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.317053] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.317053] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.317053] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.321163] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22824640-0730-4b9a-a9ef-9014ef216bc4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.744023] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.744023] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.744023] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.744023] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.744023] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.744023] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 7241fe7b-7604-4533-b717-e262b257427d not found, creating... [ 750.744023] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.744023] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.744023] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.744023] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.744023] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.744617] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.744617] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.744617] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.744617] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.744617] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.744617] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 7241fe7b-7604-4533-b717-e262b257427d is going to be created. [ 750.782063] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.782419] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.782562] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.782846] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.783091] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.783385] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-7241fe7b-7604-4533-b717-e262b257427d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.819659] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.821174] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.821371] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.823078] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22824640-0730-4b9a-a9ef-9014ef216bc4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.322460] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.326123] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.326337] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.326337] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.329772] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.329772] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.329772] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 is going to be updated. [ 751.366262] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.366489] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.366489] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.366792] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.366938] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.376709] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 in Status: IN_PROGRESS for 2s [ 751.597249] env[70520]: INFO networking_nsxv3.common.synchronization [req-c25c03e2-664d-4789-bc0f-26b581e3c346 req-9494eb21-4a1d-4071-8bf5-9466ab141750 service nova] Enqueued Resource ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 with Priority: HIGHEST for action security_group_rules [ 751.597249] env[70520]: INFO networking_nsxv3.common.synchronization [req-c25c03e2-664d-4789-bc0f-26b581e3c346 req-9494eb21-4a1d-4071-8bf5-9466ab141750 service nova] Enqueued Resource ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 with Priority: HIGHEST for action security_group_members [ 751.597249] env[70520]: INFO networking_nsxv3.common.synchronization [req-c25c03e2-664d-4789-bc0f-26b581e3c346 req-9494eb21-4a1d-4071-8bf5-9466ab141750 service nova] Enqueued Resource ID: 7241fe7b-7604-4533-b717-e262b257427d with Priority: HIGHEST for action port [ 751.598837] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 with Priority: HIGHEST for action security_group_rules [ 751.599294] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 with Priority: HIGHEST for action security_group_members [ 751.599682] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7241fe7b-7604-4533-b717-e262b257427d with Priority: HIGHEST for action port [ 751.600672] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22824640-0730-4b9a-a9ef-9014ef216bc4 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.603163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.603163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.603163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.603163] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22824640-0730-4b9a-a9ef-9014ef216bc4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.607281] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-22824640-0730-4b9a-a9ef-9014ef216bc4 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.607281] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.607281] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-7241fe7b-7604-4533-b717-e262b257427d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.607281] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7241fe7b-7604-4533-b717-e262b257427d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.607281] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7241fe7b-7604-4533-b717-e262b257427d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.607281] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7241fe7b-7604-4533-b717-e262b257427d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.607281] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7241fe7b-7604-4533-b717-e262b257427d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.826711] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.827071] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.827071] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.827315] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.827426] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.827537] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 is going to be updated. [ 751.855309] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.855465] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.855531] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.855745] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.856031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.865464] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 in Status: IN_PROGRESS for 2s [ 752.110883] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7241fe7b-7604-4533-b717-e262b257427d with status ACTIVE [ 752.111257] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.111358] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.111477] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.111779] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.112148] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.112402] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.112614] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.113432] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.113432] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.113432] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.113677] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.113773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.113947] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.114218] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.114343] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.114456] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7241fe7b-7604-4533-b717-e262b257427d is going to be updated. [ 752.116260] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-22824640-0730-4b9a-a9ef-9014ef216bc4 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.116422] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.141524] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.141692] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.141765] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.141980] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.142160] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.142334] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7241fe7b-7604-4533-b717-e262b257427d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.388252] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 in Status: SUCCESS [ 753.388681] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.388898] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.390070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.390339] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.390511] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.390588] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.390770] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.390855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.390953] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22824640-0730-4b9a-a9ef-9014ef216bc4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.572218] env[70520]: INFO networking_nsxv3.common.synchronization [req-bdd3cdb3-8011-4e59-9e13-d15b0e83b332 req-4a9acabc-ce2f-4b20-bb6e-1aa3a3c5da1a tempest-ServerActionsTestOtherB-256435736 tempest-ServerActionsTestOtherB-256435736-project-member] Enqueued Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_members [ 753.573011] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_members [ 753.573468] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d7f9020-5060-4aaf-81f1-cec3849eacc0 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.573599] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.573664] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.573917] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.574077] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.574175] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.574234] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.574384] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.574465] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.574593] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.879910] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 in Status: SUCCESS [ 753.879910] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.879910] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.879910] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.879910] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.879910] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.879910] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.879910] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.879910] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.879910] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.896096] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22824640-0730-4b9a-a9ef-9014ef216bc4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.010035] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-453 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.010202] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-453" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.010302] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-453" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.010646] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-453" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.010943] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.011483] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.011483] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.011483] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.011644] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.011867] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 754.011968] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 754.012514] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 754.012514] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 754.012514] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 754.012514] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 754.012762] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 754.035391] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 754.035526] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 754.039100] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 754.039392] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-453" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.039736] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-2f732305-3f77-40ec-98b1-5eaa8859e005 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.039920] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-2f732305-3f77-40ec-98b1-5eaa8859e005" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.040051] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-2f732305-3f77-40ec-98b1-5eaa8859e005" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.040378] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-2f732305-3f77-40ec-98b1-5eaa8859e005" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.040513] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f732305-3f77-40ec-98b1-5eaa8859e005',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.079384] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.079384] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.079384] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.079384] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.079384] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.079384] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.079384] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.079384] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.079384] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.079384] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.079384] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 already deleted. [ 754.079384] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.382042] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.399423] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22824640-0730-4b9a-a9ef-9014ef216bc4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.543565] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.543731] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.544022] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.544530] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.544890] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.545182] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 2f732305-3f77-40ec-98b1-5eaa8859e005 not found, creating... [ 754.545684] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.545929] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.546198] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.546591] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.546864] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.547392] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.547667] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.547892] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.548247] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.548461] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.548688] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 2f732305-3f77-40ec-98b1-5eaa8859e005 is going to be created. [ 754.573599] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.573881] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.574150] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.574370] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.574602] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.574890] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-2f732305-3f77-40ec-98b1-5eaa8859e005" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.886053] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.901727] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.901916] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.901965] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.902179] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.903035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.903035] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 is going to be updated. [ 754.952656] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.952941] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.953056] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.953345] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.953580] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.967760] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 in Status: IN_PROGRESS for 2s [ 755.295454] env[70520]: INFO networking_nsxv3.common.synchronization [req-bdd3cdb3-8011-4e59-9e13-d15b0e83b332 req-73fd2748-c9fc-4c0e-9063-abdde907b07d service nova] Enqueued Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_rules [ 755.296335] env[70520]: INFO networking_nsxv3.common.synchronization [req-bdd3cdb3-8011-4e59-9e13-d15b0e83b332 req-73fd2748-c9fc-4c0e-9063-abdde907b07d service nova] Enqueued Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_members [ 755.296583] env[70520]: INFO networking_nsxv3.common.synchronization [req-bdd3cdb3-8011-4e59-9e13-d15b0e83b332 req-73fd2748-c9fc-4c0e-9063-abdde907b07d service nova] Enqueued Resource ID: 2f732305-3f77-40ec-98b1-5eaa8859e005 with Priority: HIGHEST for action port [ 755.297222] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_rules [ 755.297419] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_members [ 755.297567] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f732305-3f77-40ec-98b1-5eaa8859e005 with Priority: HIGHEST for action port [ 755.297896] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.298087] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.298556] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.298960] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.299173] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.300101] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d7f9020-5060-4aaf-81f1-cec3849eacc0 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.300276] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.304541] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.304830] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.305109] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.310021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.310021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.310021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.310021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.310021] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.310021] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f732305-3f77-40ec-98b1-5eaa8859e005 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.310021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f732305-3f77-40ec-98b1-5eaa8859e005" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.310021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f732305-3f77-40ec-98b1-5eaa8859e005" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.310573] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f732305-3f77-40ec-98b1-5eaa8859e005" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.310573] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f732305-3f77-40ec-98b1-5eaa8859e005',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.389894] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.390179] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.390307] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.390621] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.390842] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.390930] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 is going to be updated. [ 755.428996] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.428996] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.428996] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.428996] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.428996] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.437540] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 in Status: IN_PROGRESS for 2s [ 755.812937] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.814046] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d7f9020-5060-4aaf-81f1-cec3849eacc0 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.814168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.814509] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2f732305-3f77-40ec-98b1-5eaa8859e005 with status ACTIVE [ 755.814672] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.815286] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.815286] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.815286] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.815286] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.815811] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.815811] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.815811] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.815811] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.815811] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.816146] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.816146] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.816146] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.816265] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.816301] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.816394] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2f732305-3f77-40ec-98b1-5eaa8859e005 is going to be updated. [ 755.842257] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.842257] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.842257] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.842612] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.842612] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.843051] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f732305-3f77-40ec-98b1-5eaa8859e005" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.315416] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.826092] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.826435] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.826435] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.826565] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.826716] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.826716] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 is going to be created. [ 756.853704] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.853877] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.855437] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.855437] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.855437] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.867471] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: UNINITIALIZED for 2s [ 756.978574] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 in Status: SUCCESS [ 756.978709] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.978832] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.979068] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.979266] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.979410] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.979476] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.979639] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.979723] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.979808] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.979903] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22824640-0730-4b9a-a9ef-9014ef216bc4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.450375] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 in Status: SUCCESS [ 757.450594] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.450762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.450997] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.451223] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.451378] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.451445] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.451608] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.451690] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.451785] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.484917] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-22824640-0730-4b9a-a9ef-9014ef216bc4 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.485245] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.485394] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.485695] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.485905] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.486120] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.486215] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.486502] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.486713] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.486713] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.486873] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-22824640-0730-4b9a-a9ef-9014ef216bc4 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.486972] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.487047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.487204] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.487350] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.487444] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.487503] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.487685] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.487790] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.487934] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.488110] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22824640-0730-4b9a-a9ef-9014ef216bc4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.954089] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.990182] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22824640-0730-4b9a-a9ef-9014ef216bc4: rpc.has_security_group_logging(os_id): False [ 758.013518] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.013518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.013518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.013518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.013518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.013518] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.013518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.013518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.013518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.013518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.013518] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.013518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.013518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.013518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.013518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.014425] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.014425] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.014425] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.014425] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.014806] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.016068] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 is going to be updated. [ 758.092319] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.092456] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.092526] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.092739] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.092894] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.107806] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 in Status: IN_PROGRESS for 2s [ 758.463362] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.880115] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: SUCCESS [ 758.880115] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.880309] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.880388] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.880568] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.880687] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.880746] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.880909] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.880988] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.883152] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.883152] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.968262] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.968262] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.968262] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.968262] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.968262] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.968262] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 is going to be updated. [ 759.000991] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.001150] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.001213] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.001556] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.001556] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.014091] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 in Status: IN_PROGRESS for 2s [ 759.109697] env[70520]: INFO networking_nsxv3.common.synchronization [None req-b95c6d0e-791d-4f5c-b01d-d3241bd273fd None None] Enqueued Resource ID: b24304ce-98df-4c20-ba49-d7cfbf12b15f with Priority: HIGHEST for action port [ 759.110290] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b24304ce-98df-4c20-ba49-d7cfbf12b15f with Priority: HIGHEST for action port [ 759.110690] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-b24304ce-98df-4c20-ba49-d7cfbf12b15f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.110768] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b24304ce-98df-4c20-ba49-d7cfbf12b15f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.110768] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b24304ce-98df-4c20-ba49-d7cfbf12b15f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.111438] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b24304ce-98df-4c20-ba49-d7cfbf12b15f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.111622] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b24304ce-98df-4c20-ba49-d7cfbf12b15f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.383715] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.616367] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b24304ce-98df-4c20-ba49-d7cfbf12b15f [ 759.616367] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.616367] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.616367] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.616367] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.616367] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.616367] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b24304ce-98df-4c20-ba49-d7cfbf12b15f already deleted. [ 759.616367] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b24304ce-98df-4c20-ba49-d7cfbf12b15f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.768831] env[70520]: INFO networking_nsxv3.common.synchronization [req-edd32ed7-901d-4be2-a0cc-5bd3174a1f6e req-80e8280e-64c6-4b53-86b7-ff9c301227d5 tempest-ListServersNegativeTestJSON-1140309429 tempest-ListServersNegativeTestJSON-1140309429-project-member] Enqueued Resource ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 with Priority: HIGHEST for action security_group_members [ 759.769859] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 with Priority: HIGHEST for action security_group_members [ 759.769859] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.769859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.886900] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d7f9020-5060-4aaf-81f1-cec3849eacc0: rpc.has_security_group_logging(os_id): False [ 759.906783] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.906783] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.906783] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.907104] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.907104] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.907188] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.907272] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.907317] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.907749] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.907749] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.907749] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 is going to be created. [ 759.974165] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.974530] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.974530] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.974606] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.975635] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.986112] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: IN_PROGRESS for 2s [ 760.123958] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 in Status: SUCCESS [ 760.124188] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.789523] env[70520]: INFO networking_nsxv3.common.synchronization [req-138d3b6c-ee4c-4cd8-843f-ff76518632e7 req-ed4be7e1-dde3-4bec-afe8-618f1e98cf48 tempest-ServersAdminNegativeTestJSON-263885956 tempest-ServersAdminNegativeTestJSON-263885956-project-member] Enqueued Resource ID: 5ba096e8-0990-4301-b10d-dee4aea7793e with Priority: HIGHEST for action security_group_members [ 760.789523] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ba096e8-0990-4301-b10d-dee4aea7793e with Priority: HIGHEST for action security_group_members [ 760.789523] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ba096e8-0990-4301-b10d-dee4aea7793e taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.789523] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.789523] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.789523] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.789523] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.790974] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.790974] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.790974] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.790974] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.790974] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ba096e8-0990-4301-b10d-dee4aea7793e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.025151] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 in Status: SUCCESS [ 761.025493] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.025588] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.025810] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.026037] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.026160] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.026240] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.026428] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.026524] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.026628] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.026797] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.026875] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.026942] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.027099] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.027232] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.027336] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.027390] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.027537] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.027609] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.027688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.027795] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.028908] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.031028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.031028] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.031028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.031028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.031028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.031028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.031028] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.206023] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-659 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.206023] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.206023] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.206023] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.206023] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.206716] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.207044] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.210658] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.210658] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.210658] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 761.210658] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.210658] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.210658] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.210658] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 761.210658] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.210658] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.231182] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.231182] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 761.231182] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.231182] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.231182] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-46351129-a41f-4a6f-8628-40debf3f6f70 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.231182] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-46351129-a41f-4a6f-8628-40debf3f6f70" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.231972] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-46351129-a41f-4a6f-8628-40debf3f6f70" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.233043] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-46351129-a41f-4a6f-8628-40debf3f6f70" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.233874] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46351129-a41f-4a6f-8628-40debf3f6f70',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.292376] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5ba096e8-0990-4301-b10d-dee4aea7793e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.531832] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6f74242-a9a2-4ad8-bc5b-6c4f15b55180: rpc.has_security_group_logging(os_id): False [ 761.534657] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.554332] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.554796] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.554796] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.554796] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.555135] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.555135] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.555243] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.555309] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.555471] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.555551] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.555767] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.555871] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.555933] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.556098] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.556161] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.556353] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.556447] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.556508] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.556651] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.556724] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.556819] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 is going to be created. [ 761.624903] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.625140] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.625205] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.625422] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.625610] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.641883] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 in Status: IN_PROGRESS for 2s [ 761.671227] env[70520]: INFO networking_nsxv3.common.synchronization [None req-f17062dd-38a5-4720-8136-5032021d9dea None None] Enqueued Resource ID: 69571261-d9cd-4b53-b1bd-47b89b75151e with Priority: HIGHEST for action port [ 761.671882] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69571261-d9cd-4b53-b1bd-47b89b75151e with Priority: HIGHEST for action port [ 761.676899] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-69571261-d9cd-4b53-b1bd-47b89b75151e taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.676899] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69571261-d9cd-4b53-b1bd-47b89b75151e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.676899] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69571261-d9cd-4b53-b1bd-47b89b75151e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.677521] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69571261-d9cd-4b53-b1bd-47b89b75151e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.677521] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69571261-d9cd-4b53-b1bd-47b89b75151e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.737705] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.737989] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.738055] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.738376] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.738733] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.738733] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 46351129-a41f-4a6f-8628-40debf3f6f70 not found, creating... [ 761.738957] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.739149] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.739263] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.739490] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.739626] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.740105] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.740105] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.740301] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.740404] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.741082] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.741082] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 46351129-a41f-4a6f-8628-40debf3f6f70 is going to be created. [ 761.771605] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.772033] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.772033] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.772361] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.772599] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.772842] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-46351129-a41f-4a6f-8628-40debf3f6f70" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.794274] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5ba096e8-0990-4301-b10d-dee4aea7793e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.998242] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: SUCCESS [ 761.998242] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.036680] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.179397] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 69571261-d9cd-4b53-b1bd-47b89b75151e [ 762.179786] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.180044] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.180317] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.180505] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.180635] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.180772] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:69571261-d9cd-4b53-b1bd-47b89b75151e already deleted. [ 762.180884] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69571261-d9cd-4b53-b1bd-47b89b75151e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.296947] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.297175] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.297249] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.297523] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.297637] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.297799] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ba096e8-0990-4301-b10d-dee4aea7793e is going to be updated. [ 762.333920] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.334356] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.334460] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.334668] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.334977] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.356593] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ba096e8-0990-4301-b10d-dee4aea7793e in Status: IN_PROGRESS for 2s [ 762.539816] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.540057] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.540146] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.540412] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.540531] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.540641] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 is going to be updated. [ 762.576203] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.576403] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.576451] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.576650] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.576824] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.597194] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 in Status: IN_PROGRESS for 2s [ 762.895904] env[70520]: INFO networking_nsxv3.common.synchronization [req-138d3b6c-ee4c-4cd8-843f-ff76518632e7 req-c8e60928-597e-4a1c-96fa-f4a114d17e37 service nova] Enqueued Resource ID: 5ba096e8-0990-4301-b10d-dee4aea7793e with Priority: HIGHEST for action security_group_rules [ 762.896094] env[70520]: INFO networking_nsxv3.common.synchronization [req-138d3b6c-ee4c-4cd8-843f-ff76518632e7 req-c8e60928-597e-4a1c-96fa-f4a114d17e37 service nova] Enqueued Resource ID: 5ba096e8-0990-4301-b10d-dee4aea7793e with Priority: HIGHEST for action security_group_members [ 762.896225] env[70520]: INFO networking_nsxv3.common.synchronization [req-138d3b6c-ee4c-4cd8-843f-ff76518632e7 req-c8e60928-597e-4a1c-96fa-f4a114d17e37 service nova] Enqueued Resource ID: 46351129-a41f-4a6f-8628-40debf3f6f70 with Priority: HIGHEST for action port [ 762.896447] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ba096e8-0990-4301-b10d-dee4aea7793e with Priority: HIGHEST for action security_group_rules [ 762.896566] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ba096e8-0990-4301-b10d-dee4aea7793e with Priority: HIGHEST for action security_group_members [ 762.896657] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46351129-a41f-4a6f-8628-40debf3f6f70 with Priority: HIGHEST for action port [ 762.897310] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ba096e8-0990-4301-b10d-dee4aea7793e taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.897437] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.897437] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.897634] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.897681] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ba096e8-0990-4301-b10d-dee4aea7793e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.899248] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ba096e8-0990-4301-b10d-dee4aea7793e taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.899349] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.904212] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-46351129-a41f-4a6f-8628-40debf3f6f70 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.904212] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46351129-a41f-4a6f-8628-40debf3f6f70" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.904212] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46351129-a41f-4a6f-8628-40debf3f6f70" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.904212] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46351129-a41f-4a6f-8628-40debf3f6f70" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.904212] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46351129-a41f-4a6f-8628-40debf3f6f70',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.405500] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ba096e8-0990-4301-b10d-dee4aea7793e taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.405500] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.405500] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 46351129-a41f-4a6f-8628-40debf3f6f70 with status ACTIVE [ 763.405500] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.405500] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.405500] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.405500] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.405500] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.405500] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.407658] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.407658] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.407779] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.407848] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.408055] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.408166] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.408227] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.408392] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.408476] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.408566] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 46351129-a41f-4a6f-8628-40debf3f6f70 is going to be updated. [ 763.430542] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.430699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.430770] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.430999] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.431183] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.431433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46351129-a41f-4a6f-8628-40debf3f6f70" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.655129] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 in Status: SUCCESS [ 763.655445] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.655639] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.655867] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.656017] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.163728] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.166365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.367913] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ba096e8-0990-4301-b10d-dee4aea7793e in Status: SUCCESS [ 764.368207] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.368388] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.368626] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.368818] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.368958] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.369070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.369245] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.369347] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.369440] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ba096e8-0990-4301-b10d-dee4aea7793e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.607162] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 in Status: SUCCESS [ 764.607162] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.607162] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.607530] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.607580] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.607744] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.607849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.609372] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.609583] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.609892] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.609960] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.872187] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5ba096e8-0990-4301-b10d-dee4aea7793e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.114630] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.114801] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.114867] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.115155] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.115342] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.115455] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.115521] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.115685] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.115773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.115871] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.116031] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.116168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.116863] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.116863] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.116863] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.116863] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.116863] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.116863] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.116863] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.117234] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.117234] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.374575] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5ba096e8-0990-4301-b10d-dee4aea7793e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.620498] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6f74242-a9a2-4ad8-bc5b-6c4f15b55180: rpc.has_security_group_logging(os_id): False [ 765.649733] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.649978] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.649978] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.650203] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.650288] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.650540] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.650668] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.650760] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.650983] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.651103] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.651379] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.651524] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.651620] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.651837] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.651987] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.652451] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.652602] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.652691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.652936] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.653103] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.653217] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 is going to be updated. [ 765.702238] env[70520]: INFO networking_nsxv3.common.synchronization [req-a3c3140f-eb5a-4766-b6f2-80531c18f936 req-493ff763-b9e1-419a-90d3-a4e3337bea8d tempest-ServersTestJSON-2073228387 tempest-ServersTestJSON-2073228387-project-member] Enqueued Resource ID: 49148979-263a-4c7a-a007-bfce9aaa037b with Priority: HIGHEST for action security_group_members [ 765.704240] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49148979-263a-4c7a-a007-bfce9aaa037b with Priority: HIGHEST for action security_group_members [ 765.704240] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-49148979-263a-4c7a-a007-bfce9aaa037b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.704240] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.704240] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.704240] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.704240] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.704240] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.704240] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.706396] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.706396] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.706396] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49148979-263a-4c7a-a007-bfce9aaa037b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.736265] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.737327] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.739107] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.739107] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.739107] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.752783] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 in Status: IN_PROGRESS for 2s [ 765.877463] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.877641] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.877710] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.877942] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.878048] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.878158] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ba096e8-0990-4301-b10d-dee4aea7793e is going to be updated. [ 765.914384] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.914534] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.914600] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.914879] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.915075] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.927711] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ba096e8-0990-4301-b10d-dee4aea7793e in Status: IN_PROGRESS for 2s [ 766.208676] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.208676] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.208676] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.208676] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.208676] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.208676] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.208676] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.208676] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.208676] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.208676] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.208676] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49148979-263a-4c7a-a007-bfce9aaa037b already deleted. [ 766.208676] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.472202] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-579 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.472409] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-579" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.472532] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-579" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.472940] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-579" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.473230] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.473392] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.473507] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.473723] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.473861] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.474231] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 766.474366] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 766.474478] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 766.474583] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 766.474789] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 766.474789] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 766.476033] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 766.494206] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 766.494374] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 766.494513] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 766.494691] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-579" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.495096] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-bfa1041c-2b84-4705-b1c0-6203f4c95575 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.495294] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-bfa1041c-2b84-4705-b1c0-6203f4c95575" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.495414] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-bfa1041c-2b84-4705-b1c0-6203f4c95575" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.495739] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-bfa1041c-2b84-4705-b1c0-6203f4c95575" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.495874] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfa1041c-2b84-4705-b1c0-6203f4c95575',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.001195] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.001558] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.001558] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.001853] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.001999] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.002170] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port bfa1041c-2b84-4705-b1c0-6203f4c95575 not found, creating... [ 767.002462] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.002601] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.002744] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.002931] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.003108] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.003937] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.003937] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.003937] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.003937] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.004099] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.004500] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: bfa1041c-2b84-4705-b1c0-6203f4c95575 is going to be created. [ 767.031536] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.031757] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.031874] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.032192] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.032398] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.032622] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-bfa1041c-2b84-4705-b1c0-6203f4c95575" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.772399] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 in Status: SUCCESS [ 767.772399] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.772399] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.772399] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.772399] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.943774] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ba096e8-0990-4301-b10d-dee4aea7793e in Status: SUCCESS [ 767.943774] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.943774] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.943774] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.943774] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.943774] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.943774] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.943774] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.943774] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.943774] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.943774] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5ba096e8-0990-4301-b10d-dee4aea7793e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.085839] env[70520]: INFO networking_nsxv3.common.synchronization [req-a3c3140f-eb5a-4766-b6f2-80531c18f936 req-0d5483b4-de7d-4d7b-94ce-b900290b38e3 service nova] Enqueued Resource ID: 49148979-263a-4c7a-a007-bfce9aaa037b with Priority: HIGHEST for action security_group_rules [ 768.086841] env[70520]: INFO networking_nsxv3.common.synchronization [req-a3c3140f-eb5a-4766-b6f2-80531c18f936 req-0d5483b4-de7d-4d7b-94ce-b900290b38e3 service nova] Enqueued Resource ID: 49148979-263a-4c7a-a007-bfce9aaa037b with Priority: HIGHEST for action security_group_members [ 768.086841] env[70520]: INFO networking_nsxv3.common.synchronization [req-a3c3140f-eb5a-4766-b6f2-80531c18f936 req-0d5483b4-de7d-4d7b-94ce-b900290b38e3 service nova] Enqueued Resource ID: bfa1041c-2b84-4705-b1c0-6203f4c95575 with Priority: HIGHEST for action port [ 768.086841] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49148979-263a-4c7a-a007-bfce9aaa037b with Priority: HIGHEST for action security_group_rules [ 768.086960] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49148979-263a-4c7a-a007-bfce9aaa037b with Priority: HIGHEST for action security_group_members [ 768.090201] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfa1041c-2b84-4705-b1c0-6203f4c95575 with Priority: HIGHEST for action port [ 768.094026] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49148979-263a-4c7a-a007-bfce9aaa037b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.094026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.094026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.094026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.094026] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49148979-263a-4c7a-a007-bfce9aaa037b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.094026] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-49148979-263a-4c7a-a007-bfce9aaa037b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.094026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.094026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.094026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.094026] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.094026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.095191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.096019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.096290] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.096491] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49148979-263a-4c7a-a007-bfce9aaa037b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.097793] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfa1041c-2b84-4705-b1c0-6203f4c95575 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.098063] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfa1041c-2b84-4705-b1c0-6203f4c95575" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.098261] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfa1041c-2b84-4705-b1c0-6203f4c95575" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.098521] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfa1041c-2b84-4705-b1c0-6203f4c95575" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.099034] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfa1041c-2b84-4705-b1c0-6203f4c95575',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.279563] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.279563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.279563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.279563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.279563] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.279563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.279563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.279563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.279563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.279563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.279563] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.450324] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ba096e8-0990-4301-b10d-dee4aea7793e taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.450324] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.450324] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.450324] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.450324] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.450324] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.450324] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.450324] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.450324] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.450324] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.450324] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ba096e8-0990-4301-b10d-dee4aea7793e taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.450324] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.450324] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.450324] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.450324] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.450324] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.450847] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.450847] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.450847] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.450847] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.450847] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5ba096e8-0990-4301-b10d-dee4aea7793e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.485796] env[70520]: INFO networking_nsxv3.common.synchronization [req-03b0040a-63c0-44f1-a0fe-3d6184353e29 req-76d0bdc6-c6eb-427a-be83-1a499de363e2 tempest-FloatingIPsAssociationTestJSON-847223640 tempest-FloatingIPsAssociationTestJSON-847223640-project-member] Enqueued Resource ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 with Priority: HIGHEST for action security_group_members [ 768.486510] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 with Priority: HIGHEST for action security_group_members [ 768.486840] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-22824640-0730-4b9a-a9ef-9014ef216bc4 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.486968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.487045] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.487261] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.487785] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.488089] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.488089] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.488252] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.488252] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.488368] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22824640-0730-4b9a-a9ef-9014ef216bc4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.600568] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49148979-263a-4c7a-a007-bfce9aaa037b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.601744] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-49148979-263a-4c7a-a007-bfce9aaa037b taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.601744] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.601920] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bfa1041c-2b84-4705-b1c0-6203f4c95575 with status ACTIVE [ 768.602150] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.602263] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.602331] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.602547] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.602658] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.602835] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.602948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.606317] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.606565] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.606659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.606865] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.606965] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.607050] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.607195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.607270] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.607402] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bfa1041c-2b84-4705-b1c0-6203f4c95575 is going to be updated. [ 768.630162] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.630325] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.630356] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.630564] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.630698] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.630863] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfa1041c-2b84-4705-b1c0-6203f4c95575" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.690920] env[70520]: INFO networking_nsxv3.common.synchronization [req-67787762-3c11-4337-b28b-effe6cf29de7 req-cf3afc68-7f41-4044-903e-7977788c7a9b tempest-ServerTagsTestJSON-1290888614 tempest-ServerTagsTestJSON-1290888614-project-member] Enqueued Resource ID: 08b813e6-789a-4955-8d67-6d589f30969c with Priority: HIGHEST for action security_group_members [ 768.691171] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08b813e6-789a-4955-8d67-6d589f30969c with Priority: HIGHEST for action security_group_members [ 768.691464] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-08b813e6-789a-4955-8d67-6d589f30969c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.691589] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.691820] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.691952] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.693389] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.693513] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.693579] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.693828] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.693828] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.693928] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08b813e6-789a-4955-8d67-6d589f30969c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.788965] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.789154] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.789215] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.789407] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.789574] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.789677] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.789739] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.789890] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.789974] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.790077] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.790255] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.790364] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.790417] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.790544] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.790677] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.790769] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.790825] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.790961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.791050] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.791131] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.791218] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.953598] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5ba096e8-0990-4301-b10d-dee4aea7793e: rpc.has_security_group_logging(os_id): False [ 768.978672] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.978788] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.978788] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.979014] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.979115] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.979311] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.979578] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.979578] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.979703] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.979703] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.979902] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.980054] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.980054] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.980313] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.980313] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.980433] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.980844] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.980870] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.981024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.981106] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.981194] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ba096e8-0990-4301-b10d-dee4aea7793e is going to be updated. [ 768.991065] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22824640-0730-4b9a-a9ef-9014ef216bc4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.047948] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.047948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.047948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.047948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.047948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.063363] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ba096e8-0990-4301-b10d-dee4aea7793e in Status: IN_PROGRESS for 2s [ 769.110024] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49148979-263a-4c7a-a007-bfce9aaa037b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.131030] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-695 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.131267] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-695" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.131436] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-695" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.132052] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-695" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.132449] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.132730] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.133166] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.133338] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.133598] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.134928] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 769.134928] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 769.134928] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 769.134928] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 769.134928] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 769.134928] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 769.135348] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 769.158576] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 769.158742] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 769.158876] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 769.159068] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-695" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.159399] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-d55ed9ee-f151-4ff4-8c1f-d8a60333f081 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.159575] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-d55ed9ee-f151-4ff4-8c1f-d8a60333f081" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.159690] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-d55ed9ee-f151-4ff4-8c1f-d8a60333f081" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.160056] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-d55ed9ee-f151-4ff4-8c1f-d8a60333f081" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.160199] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d55ed9ee-f151-4ff4-8c1f-d8a60333f081',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.196082] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.196311] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.196383] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.196604] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.196708] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.196924] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.197149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.197149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.197266] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.197359] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.197449] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08b813e6-789a-4955-8d67-6d589f30969c already deleted. [ 769.197531] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.293084] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6f74242-a9a2-4ad8-bc5b-6c4f15b55180: rpc.has_security_group_logging(os_id): False [ 769.311699] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.311861] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.315648] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.315648] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.315648] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.315648] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.315648] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.315648] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.315648] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.315648] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.315648] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.315648] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.315648] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.315648] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.315648] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.315648] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.316208] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.316208] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.316208] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.316208] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.316208] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 is going to be updated. [ 769.421905] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.421905] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.421905] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.421905] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.421905] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.462923] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 in Status: IN_PROGRESS for 2s [ 769.495490] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22824640-0730-4b9a-a9ef-9014ef216bc4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.615937] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.615937] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.615937] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.615937] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.615937] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.615937] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49148979-263a-4c7a-a007-bfce9aaa037b is going to be created. [ 769.644125] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.645551] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.645551] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.645551] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.645551] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.668656] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49148979-263a-4c7a-a007-bfce9aaa037b in Status: UNINITIALIZED for 2s [ 769.669235] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.669740] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.669740] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.669855] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.670414] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.670414] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port d55ed9ee-f151-4ff4-8c1f-d8a60333f081 not found, creating... [ 769.670414] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.670570] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.670672] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.670901] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.671455] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.671794] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.671958] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.672091] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.672444] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.672497] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.672615] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: d55ed9ee-f151-4ff4-8c1f-d8a60333f081 is going to be created. [ 769.693842] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.694100] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.694100] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.694351] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.694591] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.694809] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-d55ed9ee-f151-4ff4-8c1f-d8a60333f081" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.925215] env[70520]: INFO networking_nsxv3.common.synchronization [req-d832250a-7afd-4aca-8f01-5903b394884b req-d73d5cbb-f075-41f9-9af6-378b8cbad485 tempest-ImagesOneServerTestJSON-591360188 tempest-ImagesOneServerTestJSON-591360188-project-member] Enqueued Resource ID: bc967d33-6d28-4dd5-98c4-22ac5cda2d2e with Priority: HIGHEST for action security_group_members [ 769.925740] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc967d33-6d28-4dd5-98c4-22ac5cda2d2e with Priority: HIGHEST for action security_group_members [ 769.926261] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.926386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.926497] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.926718] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.926906] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.928095] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.928385] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.928621] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.928744] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.928856] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc967d33-6d28-4dd5-98c4-22ac5cda2d2e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.999768] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.000085] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.000161] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.000444] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.000444] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.000577] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 is going to be updated. [ 770.033455] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.033793] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.033953] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.034402] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.034643] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.052862] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 in Status: IN_PROGRESS for 2s [ 770.431980] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.432353] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.432386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.433016] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.433016] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.433121] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.433374] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.433374] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.434103] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.434189] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.434345] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc967d33-6d28-4dd5-98c4-22ac5cda2d2e is going to be updated. [ 770.485048] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.485048] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.485048] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.485048] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.485048] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.493824] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc967d33-6d28-4dd5-98c4-22ac5cda2d2e in Status: IN_PROGRESS for 2s [ 770.502166] env[70520]: INFO networking_nsxv3.common.synchronization [req-67787762-3c11-4337-b28b-effe6cf29de7 req-32e40fc0-b834-4d73-8848-0137675183b2 service nova] Enqueued Resource ID: 08b813e6-789a-4955-8d67-6d589f30969c with Priority: HIGHEST for action security_group_rules [ 770.502166] env[70520]: INFO networking_nsxv3.common.synchronization [req-67787762-3c11-4337-b28b-effe6cf29de7 req-32e40fc0-b834-4d73-8848-0137675183b2 service nova] Enqueued Resource ID: 08b813e6-789a-4955-8d67-6d589f30969c with Priority: HIGHEST for action security_group_members [ 770.502166] env[70520]: INFO networking_nsxv3.common.synchronization [req-67787762-3c11-4337-b28b-effe6cf29de7 req-32e40fc0-b834-4d73-8848-0137675183b2 service nova] Enqueued Resource ID: d55ed9ee-f151-4ff4-8c1f-d8a60333f081 with Priority: HIGHEST for action port [ 770.502166] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08b813e6-789a-4955-8d67-6d589f30969c with Priority: HIGHEST for action security_group_rules [ 770.502166] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08b813e6-789a-4955-8d67-6d589f30969c with Priority: HIGHEST for action security_group_members [ 770.502166] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d55ed9ee-f151-4ff4-8c1f-d8a60333f081 with Priority: HIGHEST for action port [ 770.502166] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08b813e6-789a-4955-8d67-6d589f30969c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.502166] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.502166] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.502166] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.502166] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08b813e6-789a-4955-8d67-6d589f30969c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.502891] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-08b813e6-789a-4955-8d67-6d589f30969c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.503494] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.503565] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.503741] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.503884] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.503980] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.504050] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.504443] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.504542] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.504653] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08b813e6-789a-4955-8d67-6d589f30969c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.505630] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-d55ed9ee-f151-4ff4-8c1f-d8a60333f081 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.505742] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d55ed9ee-f151-4ff4-8c1f-d8a60333f081" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.505807] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d55ed9ee-f151-4ff4-8c1f-d8a60333f081" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.505959] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d55ed9ee-f151-4ff4-8c1f-d8a60333f081" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.506567] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d55ed9ee-f151-4ff4-8c1f-d8a60333f081',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.008279] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-08b813e6-789a-4955-8d67-6d589f30969c taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.008410] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.008714] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08b813e6-789a-4955-8d67-6d589f30969c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.012127] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d55ed9ee-f151-4ff4-8c1f-d8a60333f081 with status ACTIVE [ 771.012127] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.012127] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.012127] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.012127] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.012379] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.012379] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.012474] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.012508] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.013123] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.013123] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.013123] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.013123] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.013123] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.013433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.013433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.013433] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d55ed9ee-f151-4ff4-8c1f-d8a60333f081 is going to be updated. [ 771.038308] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.038418] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.038501] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.038765] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.038931] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.039199] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d55ed9ee-f151-4ff4-8c1f-d8a60333f081" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.081386] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ba096e8-0990-4301-b10d-dee4aea7793e in Status: SUCCESS [ 771.081624] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.477297] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 in Status: SUCCESS [ 771.477595] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.511107] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08b813e6-789a-4955-8d67-6d589f30969c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.679689] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49148979-263a-4c7a-a007-bfce9aaa037b in Status: SUCCESS [ 771.679797] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.679896] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.680151] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.681474] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.681474] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.681474] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.681474] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.681474] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.681474] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.681474] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49148979-263a-4c7a-a007-bfce9aaa037b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.014636] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.014636] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.014636] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.014636] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.014636] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.015580] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08b813e6-789a-4955-8d67-6d589f30969c is going to be created. [ 772.043956] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.043956] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.043956] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.044271] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.044271] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.054809] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08b813e6-789a-4955-8d67-6d589f30969c in Status: UNINITIALIZED for 2s [ 772.062984] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 in Status: SUCCESS [ 772.063272] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.184429] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49148979-263a-4c7a-a007-bfce9aaa037b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.504507] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc967d33-6d28-4dd5-98c4-22ac5cda2d2e in Status: SUCCESS [ 772.504895] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc967d33-6d28-4dd5-98c4-22ac5cda2d2e deletion is rescheduled due to dependency. [ 772.504895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc967d33-6d28-4dd5-98c4-22ac5cda2d2e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.687937] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49148979-263a-4c7a-a007-bfce9aaa037b: rpc.has_security_group_logging(os_id): False [ 772.713886] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.714191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.714350] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.714651] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.714792] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.715199] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.715384] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.715503] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.715777] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.715903] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.716082] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49148979-263a-4c7a-a007-bfce9aaa037b is going to be created. [ 772.804862] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.804862] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.804862] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.804862] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.805161] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.824130] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49148979-263a-4c7a-a007-bfce9aaa037b in Status: IN_PROGRESS for 2s [ 774.069224] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08b813e6-789a-4955-8d67-6d589f30969c in Status: SUCCESS [ 774.069512] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.069611] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.069824] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.070244] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.070429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.070493] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.070659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.071589] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.071589] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.071589] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('08b813e6-789a-4955-8d67-6d589f30969c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.573602] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-08b813e6-789a-4955-8d67-6d589f30969c taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.578025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.578025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.578025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.578025] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.578025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.578025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.578025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.578025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.578025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.578025] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-08b813e6-789a-4955-8d67-6d589f30969c taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.578025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.578025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.578025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.578417] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.578417] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.578417] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.578417] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.578417] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.578587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.578587] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('08b813e6-789a-4955-8d67-6d589f30969c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.841217] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49148979-263a-4c7a-a007-bfce9aaa037b in Status: SUCCESS [ 774.841217] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.083365] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 08b813e6-789a-4955-8d67-6d589f30969c: rpc.has_security_group_logging(os_id): False [ 775.100729] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.100877] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.100949] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.101213] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.101327] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.101518] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.101621] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.101684] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.101839] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.101918] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.102126] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.102225] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.102288] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.102574] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.102574] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.102874] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.103434] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.103434] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.103434] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.103434] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.103434] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08b813e6-789a-4955-8d67-6d589f30969c is going to be created. [ 775.163697] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.163697] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.163697] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.163697] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.163697] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.174363] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08b813e6-789a-4955-8d67-6d589f30969c in Status: IN_PROGRESS for 2s [ 775.502900] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 775.503019] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 775.567648] env[70520]: INFO networking_nsxv3.common.synchronization [req-5ada9509-eb6d-4dff-85a6-c62279281acc req-7b6d715c-3f9e-4e9c-8d05-2a53ea57303e tempest-ServerDiskConfigTestJSON-984450191 tempest-ServerDiskConfigTestJSON-984450191-project-member] Enqueued Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 775.569045] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 775.569045] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.569045] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.569045] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.569045] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.569045] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.569429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.569429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.569732] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.569732] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.569732] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.665725] env[70520]: INFO networking_nsxv3.common.synchronization [None req-08dd4911-25c8-4d07-848a-1d792c95802b None None] Enqueued Resource ID: c5ce33f8-30f9-4458-9425-dea9d6f63986 with Priority: HIGHEST for action port [ 775.666341] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5ce33f8-30f9-4458-9425-dea9d6f63986 with Priority: HIGHEST for action port [ 775.666657] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5ce33f8-30f9-4458-9425-dea9d6f63986 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.671237] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5ce33f8-30f9-4458-9425-dea9d6f63986" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.671350] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5ce33f8-30f9-4458-9425-dea9d6f63986" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.672575] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5ce33f8-30f9-4458-9425-dea9d6f63986" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.672671] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5ce33f8-30f9-4458-9425-dea9d6f63986',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.075442] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.075442] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.075442] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.075442] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.075442] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.075442] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.075442] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.075442] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.075442] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.075442] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.075442] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 is going to be updated. [ 776.108821] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.108821] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.108821] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.108821] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.108821] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.131296] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: IN_PROGRESS for 2s [ 776.176432] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5ce33f8-30f9-4458-9425-dea9d6f63986 [ 776.176694] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.176841] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.176904] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.177169] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.177259] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.177360] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5ce33f8-30f9-4458-9425-dea9d6f63986 already deleted. [ 776.177466] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5ce33f8-30f9-4458-9425-dea9d6f63986" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.543144] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-265 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.543334] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-265" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.543465] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-265" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.543733] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-265" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.543986] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.544297] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.544414] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.544668] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.544812] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.545032] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.545218] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 776.545331] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 776.545433] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 776.545541] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.545772] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 776.545772] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 776.565947] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 776.566265] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 776.566429] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 776.566610] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-265" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.566935] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-d41b7b50-97b8-4bf8-acb7-e245ac4ef366 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.567134] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-d41b7b50-97b8-4bf8-acb7-e245ac4ef366" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.567254] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-d41b7b50-97b8-4bf8-acb7-e245ac4ef366" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.567606] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-d41b7b50-97b8-4bf8-acb7-e245ac4ef366" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.567745] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d41b7b50-97b8-4bf8-acb7-e245ac4ef366',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.064330] env[70520]: INFO networking_nsxv3.common.synchronization [req-0743dbaa-5f9e-43a4-8eec-e82f26a41f36 req-e90cc407-2872-4076-a90c-16f32e85336f tempest-SecurityGroupRulesNegativeTestJSON-275613699 tempest-SecurityGroupRulesNegativeTestJSON-275613699-project-member] Enqueued Resource ID: 9fa48beb-b954-400f-af99-da5ea0efee1d with Priority: HIGHEST for action security_group_rules [ 777.064953] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fa48beb-b954-400f-af99-da5ea0efee1d with Priority: HIGHEST for action security_group_rules [ 777.065557] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9fa48beb-b954-400f-af99-da5ea0efee1d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.065681] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9fa48beb-b954-400f-af99-da5ea0efee1d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.065755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9fa48beb-b954-400f-af99-da5ea0efee1d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.066043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9fa48beb-b954-400f-af99-da5ea0efee1d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.066147] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9fa48beb-b954-400f-af99-da5ea0efee1d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.071052] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.071281] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.071410] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.071727] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.072424] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.072424] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port d41b7b50-97b8-4bf8-acb7-e245ac4ef366 not found, creating... [ 777.072424] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.072638] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.072638] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.073522] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.073522] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.073522] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.073522] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.073653] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.073854] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.073985] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.077415] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: d41b7b50-97b8-4bf8-acb7-e245ac4ef366 is going to be created. [ 777.102021] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.102332] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.102476] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.103029] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.103029] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.103725] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-d41b7b50-97b8-4bf8-acb7-e245ac4ef366" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.189737] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08b813e6-789a-4955-8d67-6d589f30969c in Status: SUCCESS [ 777.189737] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.209989] env[70520]: INFO networking_nsxv3.common.synchronization [req-34ae61b0-7d6b-426a-8179-9fabb1bd2108 req-eb0ad189-85eb-47d1-af72-fd8cd15116f6 tempest-ServersAdminNegativeTestJSON-263885956 tempest-ServersAdminNegativeTestJSON-263885956-project-member] Enqueued Resource ID: 5ba096e8-0990-4301-b10d-dee4aea7793e with Priority: HIGHEST for action security_group_members [ 777.209989] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ba096e8-0990-4301-b10d-dee4aea7793e with Priority: HIGHEST for action security_group_members [ 777.214276] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ba096e8-0990-4301-b10d-dee4aea7793e taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.214429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.214500] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.214722] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.214900] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.215088] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.215088] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.215272] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.215360] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.215841] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ba096e8-0990-4301-b10d-dee4aea7793e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.265728] env[70520]: INFO networking_nsxv3.common.synchronization [req-3c3de2ef-8f88-46fb-96aa-bf3b1934118f req-657ddc07-0767-4c3e-a612-834017e5c83c tempest-SecurityGroupRulesNegativeTestJSON-275613699 tempest-SecurityGroupRulesNegativeTestJSON-275613699-project-member] Enqueued Resource ID: 9fa48beb-b954-400f-af99-da5ea0efee1d with Priority: HIGHEST for action security_group_rules [ 777.266607] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fa48beb-b954-400f-af99-da5ea0efee1d with Priority: HIGHEST for action security_group_rules [ 777.266777] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9fa48beb-b954-400f-af99-da5ea0efee1d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.266844] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9fa48beb-b954-400f-af99-da5ea0efee1d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.552432] env[70520]: INFO networking_nsxv3.common.synchronization [None req-36ab4cc5-d24d-45ea-9d0e-c5131b3e21b1 None None] Enqueued Resource ID: e9439756-8580-4bca-a96b-4c744ae2bbb3 with Priority: HIGHEST for action port [ 777.552432] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9439756-8580-4bca-a96b-4c744ae2bbb3 with Priority: HIGHEST for action port [ 777.552964] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9439756-8580-4bca-a96b-4c744ae2bbb3 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.554029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9439756-8580-4bca-a96b-4c744ae2bbb3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.554029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9439756-8580-4bca-a96b-4c744ae2bbb3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.554029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9439756-8580-4bca-a96b-4c744ae2bbb3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.554029] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9439756-8580-4bca-a96b-4c744ae2bbb3',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.589563] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.589563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.589563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.589563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.589563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.589563] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fa48beb-b954-400f-af99-da5ea0efee1d already deleted. [ 777.589563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9fa48beb-b954-400f-af99-da5ea0efee1d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.589563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9fa48beb-b954-400f-af99-da5ea0efee1d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.589871] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9fa48beb-b954-400f-af99-da5ea0efee1d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.589871] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9fa48beb-b954-400f-af99-da5ea0efee1d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.718395] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5ba096e8-0990-4301-b10d-dee4aea7793e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.926598] env[70520]: INFO networking_nsxv3.common.synchronization [req-5ada9509-eb6d-4dff-85a6-c62279281acc req-3c631424-833e-47ab-b980-c8f07a4c0ecb service nova] Enqueued Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_rules [ 777.926687] env[70520]: INFO networking_nsxv3.common.synchronization [req-5ada9509-eb6d-4dff-85a6-c62279281acc req-3c631424-833e-47ab-b980-c8f07a4c0ecb service nova] Enqueued Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 777.926996] env[70520]: INFO networking_nsxv3.common.synchronization [req-5ada9509-eb6d-4dff-85a6-c62279281acc req-3c631424-833e-47ab-b980-c8f07a4c0ecb service nova] Enqueued Resource ID: d41b7b50-97b8-4bf8-acb7-e245ac4ef366 with Priority: HIGHEST for action port [ 777.926996] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_rules [ 777.927131] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 777.927238] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d41b7b50-97b8-4bf8-acb7-e245ac4ef366 with Priority: HIGHEST for action port [ 777.932243] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.932461] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.932530] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.932707] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.932840] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.933815] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.933941] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.934360] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-d41b7b50-97b8-4bf8-acb7-e245ac4ef366 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.934360] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d41b7b50-97b8-4bf8-acb7-e245ac4ef366" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.934360] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d41b7b50-97b8-4bf8-acb7-e245ac4ef366" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.934504] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d41b7b50-97b8-4bf8-acb7-e245ac4ef366" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.934540] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d41b7b50-97b8-4bf8-acb7-e245ac4ef366',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.055688] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e9439756-8580-4bca-a96b-4c744ae2bbb3 [ 778.055982] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.056074] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.056234] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.056411] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.056517] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.056636] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e9439756-8580-4bca-a96b-4c744ae2bbb3 already deleted. [ 778.056766] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9439756-8580-4bca-a96b-4c744ae2bbb3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.112135] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.112282] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.112348] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.112557] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.112684] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.112805] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fa48beb-b954-400f-af99-da5ea0efee1d already deleted. [ 778.112891] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9fa48beb-b954-400f-af99-da5ea0efee1d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.141958] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: SUCCESS [ 778.144590] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 deletion is rescheduled due to dependency. [ 778.144590] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.144893] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.145195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.145533] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.145776] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.145859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.146090] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.146243] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.146373] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.222858] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5ba096e8-0990-4301-b10d-dee4aea7793e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.436829] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.437469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.440356] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d41b7b50-97b8-4bf8-acb7-e245ac4ef366 with status ACTIVE [ 778.440501] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.440629] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.440695] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.440914] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.441072] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.441182] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.441283] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.441340] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.441529] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.441588] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.441737] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.441829] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.441883] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.442031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.442105] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.442190] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d41b7b50-97b8-4bf8-acb7-e245ac4ef366 is going to be updated. [ 778.468146] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.468297] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.468388] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.468562] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.468694] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.468873] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d41b7b50-97b8-4bf8-acb7-e245ac4ef366" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.649040] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.668765] env[70520]: INFO networking_nsxv3.common.synchronization [req-4a9e99fd-6c2e-4489-8c18-bcc6ba3fe117 req-0a7c41b4-9b19-44bf-b323-586d270f593f tempest-ServerDiagnosticsNegativeTest-38847093 tempest-ServerDiagnosticsNegativeTest-38847093-project-member] Enqueued Resource ID: 56132737-31b7-4de9-bac0-8ba06203bf23 with Priority: HIGHEST for action security_group_members [ 778.669932] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56132737-31b7-4de9-bac0-8ba06203bf23 with Priority: HIGHEST for action security_group_members [ 778.671754] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-56132737-31b7-4de9-bac0-8ba06203bf23 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.671754] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.671754] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.671754] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.671754] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.671754] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.672224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.672224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.672442] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.672599] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56132737-31b7-4de9-bac0-8ba06203bf23',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.728224] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.728386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.728449] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.728721] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.728755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.728832] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ba096e8-0990-4301-b10d-dee4aea7793e is going to be updated. [ 778.760700] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.760887] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.760887] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.761119] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.761282] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.777380] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ba096e8-0990-4301-b10d-dee4aea7793e in Status: IN_PROGRESS for 2s [ 779.150560] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.176335] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.176500] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.176570] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.176778] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.176865] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.177101] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.177210] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.177274] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.177436] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.177506] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.177589] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56132737-31b7-4de9-bac0-8ba06203bf23 already deleted. [ 779.177664] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.268870] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-659 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.269202] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.269202] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.269444] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.269720] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.269905] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.273502] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.273502] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.273502] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.273502] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 779.273502] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 779.273502] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 779.273502] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 779.273502] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 779.273502] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 779.273502] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 779.294095] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 779.294095] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 779.294095] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 779.294095] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.294095] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-1369fe20-4783-4533-8f62-e384ff458531 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.294095] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-1369fe20-4783-4533-8f62-e384ff458531" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.294095] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-1369fe20-4783-4533-8f62-e384ff458531" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.294095] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-1369fe20-4783-4533-8f62-e384ff458531" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.294095] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1369fe20-4783-4533-8f62-e384ff458531',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.653280] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.653548] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.653656] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.654026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.654201] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.654310] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 is going to be updated. [ 779.685887] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.686072] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.686212] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.686469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.686650] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.697574] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: IN_PROGRESS for 2s [ 779.798086] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.798086] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.798086] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.798272] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.798311] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.798456] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 1369fe20-4783-4533-8f62-e384ff458531 not found, creating... [ 779.798708] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.798890] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.799043] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.799295] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.799443] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.799750] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.799918] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.800054] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.800267] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.800416] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.800558] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 1369fe20-4783-4533-8f62-e384ff458531 is going to be created. [ 779.821493] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.821686] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.821812] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.822129] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.822363] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.822589] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-1369fe20-4783-4533-8f62-e384ff458531" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.699384] env[70520]: INFO networking_nsxv3.common.synchronization [req-4a9e99fd-6c2e-4489-8c18-bcc6ba3fe117 req-f7fe7748-bd81-4891-93a5-94e876455344 service nova] Enqueued Resource ID: 56132737-31b7-4de9-bac0-8ba06203bf23 with Priority: HIGHEST for action security_group_rules [ 780.699384] env[70520]: INFO networking_nsxv3.common.synchronization [req-4a9e99fd-6c2e-4489-8c18-bcc6ba3fe117 req-f7fe7748-bd81-4891-93a5-94e876455344 service nova] Enqueued Resource ID: 56132737-31b7-4de9-bac0-8ba06203bf23 with Priority: HIGHEST for action security_group_members [ 780.699795] env[70520]: INFO networking_nsxv3.common.synchronization [req-4a9e99fd-6c2e-4489-8c18-bcc6ba3fe117 req-f7fe7748-bd81-4891-93a5-94e876455344 service nova] Enqueued Resource ID: 1369fe20-4783-4533-8f62-e384ff458531 with Priority: HIGHEST for action port [ 780.699964] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56132737-31b7-4de9-bac0-8ba06203bf23 with Priority: HIGHEST for action security_group_rules [ 780.701710] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56132737-31b7-4de9-bac0-8ba06203bf23 with Priority: HIGHEST for action security_group_members [ 780.701710] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1369fe20-4783-4533-8f62-e384ff458531 with Priority: HIGHEST for action port [ 780.701710] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56132737-31b7-4de9-bac0-8ba06203bf23 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.701710] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.701710] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.701710] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.701710] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56132737-31b7-4de9-bac0-8ba06203bf23',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.702807] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-56132737-31b7-4de9-bac0-8ba06203bf23 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.702807] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.702807] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.703050] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.703461] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.703461] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.703461] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.703595] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.703595] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.703661] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56132737-31b7-4de9-bac0-8ba06203bf23',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.705298] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-1369fe20-4783-4533-8f62-e384ff458531 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.705480] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1369fe20-4783-4533-8f62-e384ff458531" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.705590] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1369fe20-4783-4533-8f62-e384ff458531" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.705884] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1369fe20-4783-4533-8f62-e384ff458531" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.705884] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1369fe20-4783-4533-8f62-e384ff458531',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.787542] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ba096e8-0990-4301-b10d-dee4aea7793e in Status: SUCCESS [ 780.787777] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.207656] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56132737-31b7-4de9-bac0-8ba06203bf23',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.208766] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-56132737-31b7-4de9-bac0-8ba06203bf23 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.208898] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.209244] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1369fe20-4783-4533-8f62-e384ff458531 with status ACTIVE [ 781.209410] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.209543] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.209607] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.209841] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.209953] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.210149] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.210249] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.210313] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.210483] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.210566] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.211775] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.211775] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.211775] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.211775] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.211775] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.211775] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1369fe20-4783-4533-8f62-e384ff458531 is going to be updated. [ 781.232512] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.232713] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.232713] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.232931] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.233075] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.233248] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1369fe20-4783-4533-8f62-e384ff458531" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.707159] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: SUCCESS [ 781.707559] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.707559] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.707791] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.708028] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.708198] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.708268] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.708430] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.708510] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.708594] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.708685] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.709596] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56132737-31b7-4de9-bac0-8ba06203bf23',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.211277] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.211448] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.211522] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.211791] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.211907] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.212073] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.212201] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.212345] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.212438] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.212530] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.212683] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.212776] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.212838] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.212980] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.213228] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.213334] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.214551] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.214921] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.215028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.215159] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.215259] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.216804] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.217065] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.217159] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.217470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.217712] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.217828] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56132737-31b7-4de9-bac0-8ba06203bf23 is going to be created. [ 782.244311] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.244467] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.244539] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.244897] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.244897] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.256068] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56132737-31b7-4de9-bac0-8ba06203bf23 in Status: UNINITIALIZED for 2s [ 782.721784] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a23aa860-12db-4b07-ac46-cf4709db7164: rpc.has_security_group_logging(os_id): False [ 782.741256] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.742410] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.742948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.744753] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.744753] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.744753] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.744753] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.744753] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.744753] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.744753] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.744753] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.744753] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.744753] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.744753] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.744753] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.745806] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.745806] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.745806] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.747872] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.747872] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.747872] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 is going to be updated. [ 782.818602] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.818760] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.818821] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.819086] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.819325] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.836546] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: IN_PROGRESS for 2s [ 784.267638] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56132737-31b7-4de9-bac0-8ba06203bf23 in Status: SUCCESS [ 784.267971] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.268121] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.269666] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.269958] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.270123] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.270189] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.270391] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.270479] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.270572] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.270665] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('56132737-31b7-4de9-bac0-8ba06203bf23',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.775253] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-56132737-31b7-4de9-bac0-8ba06203bf23 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.775253] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.775253] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.775497] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.775561] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.775917] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.775917] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.775917] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.776179] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.776179] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.776258] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-56132737-31b7-4de9-bac0-8ba06203bf23 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.776351] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.776400] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.776536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.776731] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.776805] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.776877] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.776999] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.777087] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.777164] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.777254] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('56132737-31b7-4de9-bac0-8ba06203bf23',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.851651] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: SUCCESS [ 784.851918] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.219233] env[70520]: INFO networking_nsxv3.common.synchronization [req-81f646a3-7d21-4c06-b9c1-c07e383cd12e req-8e1573bd-2c49-4b7c-9642-46499405ee7d tempest-ServerTagsTestJSON-1290888614 tempest-ServerTagsTestJSON-1290888614-project-member] Enqueued Resource ID: 08b813e6-789a-4955-8d67-6d589f30969c with Priority: HIGHEST for action security_group_members [ 785.219828] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08b813e6-789a-4955-8d67-6d589f30969c with Priority: HIGHEST for action security_group_members [ 785.224247] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-08b813e6-789a-4955-8d67-6d589f30969c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.224378] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.224447] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.224668] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.224835] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.224934] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.224995] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.225173] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.225274] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.225434] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08b813e6-789a-4955-8d67-6d589f30969c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.279795] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 56132737-31b7-4de9-bac0-8ba06203bf23: rpc.has_security_group_logging(os_id): False [ 785.301034] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.301034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.301034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.301034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.301034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.301034] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.301034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.301034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.301034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.301034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.301034] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.301034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.301034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.301034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.301034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.301596] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.301596] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.301596] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.301596] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.301596] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.301596] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56132737-31b7-4de9-bac0-8ba06203bf23 is going to be created. [ 785.363741] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.363974] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.364121] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.364401] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.364614] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.379885] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56132737-31b7-4de9-bac0-8ba06203bf23 in Status: IN_PROGRESS for 2s [ 785.728872] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.728872] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.729068] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.729182] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.729280] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.729473] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.729570] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.729631] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.729779] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.729854] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.730384] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08b813e6-789a-4955-8d67-6d589f30969c is going to be updated. [ 785.761212] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.761367] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.761404] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.761702] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.762295] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.772843] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08b813e6-789a-4955-8d67-6d589f30969c in Status: IN_PROGRESS for 2s [ 786.695325] env[70520]: INFO networking_nsxv3.common.synchronization [None req-4427a0f4-970d-42e7-9bc8-f16fc84385d9 None None] Enqueued Resource ID: 1c85c01e-7112-4e3d-9ab6-d57e9e979a2c with Priority: HIGHEST for action port [ 786.695325] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c85c01e-7112-4e3d-9ab6-d57e9e979a2c with Priority: HIGHEST for action port [ 786.695325] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c85c01e-7112-4e3d-9ab6-d57e9e979a2c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.695325] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c85c01e-7112-4e3d-9ab6-d57e9e979a2c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.695325] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c85c01e-7112-4e3d-9ab6-d57e9e979a2c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.695325] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c85c01e-7112-4e3d-9ab6-d57e9e979a2c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.695325] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c85c01e-7112-4e3d-9ab6-d57e9e979a2c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.202341] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1c85c01e-7112-4e3d-9ab6-d57e9e979a2c [ 787.202631] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.202705] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.202783] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.203025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.203168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.203168] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1c85c01e-7112-4e3d-9ab6-d57e9e979a2c already deleted. [ 787.203256] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c85c01e-7112-4e3d-9ab6-d57e9e979a2c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.404601] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56132737-31b7-4de9-bac0-8ba06203bf23 in Status: SUCCESS [ 787.404831] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.702205] env[70520]: INFO networking_nsxv3.common.synchronization [None req-fd7d2b3c-b4aa-4e61-9e2e-bf5934d0c7d9 tempest-ServersTestFqdnHostnames-896096734 tempest-ServersTestFqdnHostnames-896096734-project-member] Enqueued Resource ID: 653491db-2944-4ea2-bef7-8e2800a4b41b with Priority: HIGHEST for action security_group_rules [ 787.702910] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653491db-2944-4ea2-bef7-8e2800a4b41b with Priority: HIGHEST for action security_group_rules [ 787.702910] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-653491db-2944-4ea2-bef7-8e2800a4b41b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.702910] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-653491db-2944-4ea2-bef7-8e2800a4b41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.703060] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-653491db-2944-4ea2-bef7-8e2800a4b41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.706321] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-653491db-2944-4ea2-bef7-8e2800a4b41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.706321] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('653491db-2944-4ea2-bef7-8e2800a4b41b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.789168] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08b813e6-789a-4955-8d67-6d589f30969c in Status: SUCCESS [ 787.789333] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08b813e6-789a-4955-8d67-6d589f30969c deletion is rescheduled due to dependency. [ 787.789450] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.825636] env[70520]: INFO networking_nsxv3.common.synchronization [None req-2dc231e2-3ffd-45c7-abe1-17ca9491004e tempest-ServersTestFqdnHostnames-896096734 tempest-ServersTestFqdnHostnames-896096734-project-member] Enqueued Resource ID: 653491db-2944-4ea2-bef7-8e2800a4b41b with Priority: HIGHEST for action security_group_rules [ 787.826136] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653491db-2944-4ea2-bef7-8e2800a4b41b with Priority: HIGHEST for action security_group_rules [ 787.826502] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-653491db-2944-4ea2-bef7-8e2800a4b41b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.826638] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-653491db-2944-4ea2-bef7-8e2800a4b41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.229539] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.229645] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.229727] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.229959] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.230109] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.230220] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 653491db-2944-4ea2-bef7-8e2800a4b41b already deleted. [ 788.230349] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-653491db-2944-4ea2-bef7-8e2800a4b41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.230586] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-653491db-2944-4ea2-bef7-8e2800a4b41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.230818] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-653491db-2944-4ea2-bef7-8e2800a4b41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.230925] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('653491db-2944-4ea2-bef7-8e2800a4b41b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.756986] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.756986] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.756986] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.756986] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.756986] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.756986] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 653491db-2944-4ea2-bef7-8e2800a4b41b already deleted. [ 788.756986] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-653491db-2944-4ea2-bef7-8e2800a4b41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.013019] env[70520]: INFO networking_nsxv3.common.synchronization [None req-e7804cca-e46f-4408-8514-5a8420a2a23c None None] Enqueued Resource ID: 389e6786-3275-47e5-b066-dcc51bfb0b42 with Priority: HIGHEST for action port [ 789.013882] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 389e6786-3275-47e5-b066-dcc51bfb0b42 with Priority: HIGHEST for action port [ 789.013882] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-389e6786-3275-47e5-b066-dcc51bfb0b42 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.015044] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-389e6786-3275-47e5-b066-dcc51bfb0b42" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.015044] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-389e6786-3275-47e5-b066-dcc51bfb0b42" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.015044] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-389e6786-3275-47e5-b066-dcc51bfb0b42" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.015044] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('389e6786-3275-47e5-b066-dcc51bfb0b42',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.302872] env[70520]: INFO networking_nsxv3.common.synchronization [req-2a15ffd1-2bb9-4de4-b818-493e86dbce33 req-1339b7fe-0404-4645-8164-40a4fbc8b8a0 tempest-ServerGroupTestJSON-99871040 tempest-ServerGroupTestJSON-99871040-project-member] Enqueued Resource ID: 1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 with Priority: HIGHEST for action security_group_members [ 789.302872] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 with Priority: HIGHEST for action security_group_members [ 789.302872] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.302872] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.302872] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.302872] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.302872] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.303901] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.304165] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.304463] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.304680] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.304894] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.517701] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 389e6786-3275-47e5-b066-dcc51bfb0b42 [ 789.517946] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.518100] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.518170] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.518383] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.518478] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.518575] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:389e6786-3275-47e5-b066-dcc51bfb0b42 already deleted. [ 789.518655] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-389e6786-3275-47e5-b066-dcc51bfb0b42" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.729520] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-69 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.729730] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-69" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.729854] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-69" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.730362] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-69" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.730677] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.730883] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.731043] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.731323] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.731509] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.731757] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 789.731918] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 789.732056] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 789.732199] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 789.732370] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 789.732517] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 789.732689] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 789.755040] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 789.755326] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 789.755476] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 789.755657] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-69" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.755989] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-399b298c-d374-41c4-9226-d192d769cc2c taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.756215] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-399b298c-d374-41c4-9226-d192d769cc2c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.756360] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-399b298c-d374-41c4-9226-d192d769cc2c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.756675] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-399b298c-d374-41c4-9226-d192d769cc2c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.756813] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('399b298c-d374-41c4-9226-d192d769cc2c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.807517] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.807829] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.807829] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.808030] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.808095] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.808353] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.808426] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.808464] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.808653] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.808747] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.808868] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 already deleted. [ 789.808994] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.259833] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.260378] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.260429] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.260772] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.260933] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.261103] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 399b298c-d374-41c4-9226-d192d769cc2c not found, creating... [ 790.261411] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.261591] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.261715] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.262175] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.263873] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.263873] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.263873] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.263873] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.263873] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.263873] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.263873] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 399b298c-d374-41c4-9226-d192d769cc2c is going to be created. [ 790.284341] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.284697] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.284917] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.285459] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.285967] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.286349] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-399b298c-d374-41c4-9226-d192d769cc2c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.030680] env[70520]: INFO networking_nsxv3.common.synchronization [req-36920701-06f8-4db6-89f7-2806a5f85093 req-cfde9906-7283-441c-bd6e-e465c36c5477 tempest-ServerDiagnosticsNegativeTest-38847093 tempest-ServerDiagnosticsNegativeTest-38847093-project-member] Enqueued Resource ID: 56132737-31b7-4de9-bac0-8ba06203bf23 with Priority: HIGHEST for action security_group_members [ 791.031326] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56132737-31b7-4de9-bac0-8ba06203bf23 with Priority: HIGHEST for action security_group_members [ 791.032083] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-56132737-31b7-4de9-bac0-8ba06203bf23 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.032083] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.032083] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.032273] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.032596] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.032596] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.032596] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.032934] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.032934] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.032934] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56132737-31b7-4de9-bac0-8ba06203bf23',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.095180] env[70520]: INFO networking_nsxv3.common.synchronization [req-2a15ffd1-2bb9-4de4-b818-493e86dbce33 req-f56b1129-e2be-47b9-b2e6-8bdd632e1a7b service nova] Enqueued Resource ID: 1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 with Priority: HIGHEST for action security_group_rules [ 791.095180] env[70520]: INFO networking_nsxv3.common.synchronization [req-2a15ffd1-2bb9-4de4-b818-493e86dbce33 req-f56b1129-e2be-47b9-b2e6-8bdd632e1a7b service nova] Enqueued Resource ID: 1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 with Priority: HIGHEST for action security_group_members [ 791.095180] env[70520]: INFO networking_nsxv3.common.synchronization [req-2a15ffd1-2bb9-4de4-b818-493e86dbce33 req-f56b1129-e2be-47b9-b2e6-8bdd632e1a7b service nova] Enqueued Resource ID: 399b298c-d374-41c4-9226-d192d769cc2c with Priority: HIGHEST for action port [ 791.097120] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 with Priority: HIGHEST for action security_group_rules [ 791.097570] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 with Priority: HIGHEST for action security_group_members [ 791.097815] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 399b298c-d374-41c4-9226-d192d769cc2c with Priority: HIGHEST for action port [ 791.099104] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.101043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.101043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.101043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.101043] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.101043] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.104811] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.104811] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.104811] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.104811] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.104811] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.104811] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.105299] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.105299] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.105299] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.109394] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-399b298c-d374-41c4-9226-d192d769cc2c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.109394] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-399b298c-d374-41c4-9226-d192d769cc2c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.109394] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-399b298c-d374-41c4-9226-d192d769cc2c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.109394] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-399b298c-d374-41c4-9226-d192d769cc2c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.109394] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('399b298c-d374-41c4-9226-d192d769cc2c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.535507] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.537016] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.537016] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.537016] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.537016] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.539480] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.539480] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.539480] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.539480] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.539480] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.542506] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56132737-31b7-4de9-bac0-8ba06203bf23 is going to be updated. [ 791.565708] env[70520]: INFO networking_nsxv3.common.synchronization [None req-0d7e93b1-552b-4a79-b063-7111ce8309c3 tempest-MigrationsAdminTest-360924409 tempest-MigrationsAdminTest-360924409-project-member] Enqueued Resource ID: aaa3e0fa-e2a9-4b9d-9961-f63f8b5432fb with Priority: HIGHEST for action security_group_rules [ 791.566930] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaa3e0fa-e2a9-4b9d-9961-f63f8b5432fb with Priority: HIGHEST for action security_group_rules [ 791.567743] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aaa3e0fa-e2a9-4b9d-9961-f63f8b5432fb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.570154] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aaa3e0fa-e2a9-4b9d-9961-f63f8b5432fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.570154] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aaa3e0fa-e2a9-4b9d-9961-f63f8b5432fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.570154] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aaa3e0fa-e2a9-4b9d-9961-f63f8b5432fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.570154] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aaa3e0fa-e2a9-4b9d-9961-f63f8b5432fb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.737196] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.737196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.737196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.737196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.737196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.737196] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.737451] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.737451] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.737550] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 399b298c-d374-41c4-9226-d192d769cc2c with status ACTIVE [ 791.737940] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.737940] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.737940] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.738181] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.738181] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.738246] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.738613] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.738613] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.738613] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.738613] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.738766] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.738815] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.738863] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.739221] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.739221] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.739221] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 399b298c-d374-41c4-9226-d192d769cc2c is going to be updated. [ 791.741336] env[70520]: INFO networking_nsxv3.common.synchronization [None req-e15399be-5c1c-46a5-b8ff-2fb9a441145f tempest-MigrationsAdminTest-360924409 tempest-MigrationsAdminTest-360924409-project-member] Enqueued Resource ID: aaa3e0fa-e2a9-4b9d-9961-f63f8b5432fb with Priority: HIGHEST for action security_group_rules [ 791.742151] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaa3e0fa-e2a9-4b9d-9961-f63f8b5432fb with Priority: HIGHEST for action security_group_rules [ 791.743051] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aaa3e0fa-e2a9-4b9d-9961-f63f8b5432fb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.743152] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aaa3e0fa-e2a9-4b9d-9961-f63f8b5432fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.758987] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56132737-31b7-4de9-bac0-8ba06203bf23 in Status: IN_PROGRESS for 2s [ 791.767381] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.767561] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.767652] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.767884] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.768054] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.768230] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-399b298c-d374-41c4-9226-d192d769cc2c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.246361] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.281023] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.281023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.281023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.281023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.281023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.281023] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aaa3e0fa-e2a9-4b9d-9961-f63f8b5432fb already deleted. [ 792.281023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aaa3e0fa-e2a9-4b9d-9961-f63f8b5432fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.281023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aaa3e0fa-e2a9-4b9d-9961-f63f8b5432fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.281023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aaa3e0fa-e2a9-4b9d-9961-f63f8b5432fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.281023] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aaa3e0fa-e2a9-4b9d-9961-f63f8b5432fb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.748372] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.748535] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.748600] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.748810] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.748902] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.749010] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 is going to be created. [ 792.782083] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.782434] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.782434] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.782603] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.782778] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.799477] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 in Status: UNINITIALIZED for 2s [ 792.805652] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.805837] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.805894] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.807021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.807021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.807021] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aaa3e0fa-e2a9-4b9d-9961-f63f8b5432fb already deleted. [ 792.807021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aaa3e0fa-e2a9-4b9d-9961-f63f8b5432fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.687227] env[70520]: INFO networking_nsxv3.common.synchronization [req-7d45e1c5-d5d6-443f-a8bc-8f6ef25c3a33 req-a1cc8ee8-3b34-48c4-9a7a-f9c3cb37423b tempest-DeleteServersAdminTestJSON-1646148384 tempest-DeleteServersAdminTestJSON-1646148384-project-member] Enqueued Resource ID: e84213b0-a32e-49bf-97aa-67c24de8104c with Priority: HIGHEST for action security_group_members [ 793.687227] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84213b0-a32e-49bf-97aa-67c24de8104c with Priority: HIGHEST for action security_group_members [ 793.687227] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84213b0-a32e-49bf-97aa-67c24de8104c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.687227] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.687227] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.687227] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.688377] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.688738] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.688904] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.689172] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.689347] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.689517] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e84213b0-a32e-49bf-97aa-67c24de8104c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.769716] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56132737-31b7-4de9-bac0-8ba06203bf23 in Status: SUCCESS [ 793.769904] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56132737-31b7-4de9-bac0-8ba06203bf23 deletion is rescheduled due to dependency. [ 793.770029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.094098] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-659 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.094098] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.094098] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.094098] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.094098] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.094514] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.094514] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.094514] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.094661] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.094886] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 794.094963] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 794.095065] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 794.095256] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 794.095314] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 794.095388] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 794.095513] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 794.115336] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 794.115520] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 794.115659] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 794.115833] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.116414] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-59da7bf8-0d98-4c0a-b680-88d76cf06160 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.116414] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-59da7bf8-0d98-4c0a-b680-88d76cf06160" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.117406] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-59da7bf8-0d98-4c0a-b680-88d76cf06160" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.118358] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-59da7bf8-0d98-4c0a-b680-88d76cf06160" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.118358] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59da7bf8-0d98-4c0a-b680-88d76cf06160',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.194064] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.194064] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.194064] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.194064] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.194064] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.194064] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.194064] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.194064] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.194064] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.194064] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.194064] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84213b0-a32e-49bf-97aa-67c24de8104c is going to be updated. [ 794.222070] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.222070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.222070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.222070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.222070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.232132] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84213b0-a32e-49bf-97aa-67c24de8104c in Status: IN_PROGRESS for 2s [ 794.619950] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.620212] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.620550] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.620620] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.620768] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.620923] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 59da7bf8-0d98-4c0a-b680-88d76cf06160 not found, creating... [ 794.621268] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.621430] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.621544] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.621783] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.621920] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.622259] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.622418] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.622534] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.622741] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.622872] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.623035] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 59da7bf8-0d98-4c0a-b680-88d76cf06160 is going to be created. [ 794.654334] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.654552] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.654674] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.654949] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.655204] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.655533] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-59da7bf8-0d98-4c0a-b680-88d76cf06160" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.812615] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 in Status: SUCCESS [ 794.815059] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.815059] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.815059] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.815059] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.815059] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.815059] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.815059] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.815059] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.815059] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.815059] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.318511] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.318735] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.318853] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.319160] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.319400] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.319659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.319659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.319865] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.319990] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.320130] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.320349] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.320479] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.320576] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.320779] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.320981] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.321368] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.321468] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.321681] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.321795] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.321914] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.322049] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.421730] env[70520]: INFO networking_nsxv3.common.synchronization [req-7d45e1c5-d5d6-443f-a8bc-8f6ef25c3a33 req-e3c5f951-a431-48ac-bb85-23bd26e408ed service nova] Enqueued Resource ID: e84213b0-a32e-49bf-97aa-67c24de8104c with Priority: HIGHEST for action security_group_rules [ 795.421921] env[70520]: INFO networking_nsxv3.common.synchronization [req-7d45e1c5-d5d6-443f-a8bc-8f6ef25c3a33 req-e3c5f951-a431-48ac-bb85-23bd26e408ed service nova] Enqueued Resource ID: e84213b0-a32e-49bf-97aa-67c24de8104c with Priority: HIGHEST for action security_group_members [ 795.422072] env[70520]: INFO networking_nsxv3.common.synchronization [req-7d45e1c5-d5d6-443f-a8bc-8f6ef25c3a33 req-e3c5f951-a431-48ac-bb85-23bd26e408ed service nova] Enqueued Resource ID: 59da7bf8-0d98-4c0a-b680-88d76cf06160 with Priority: HIGHEST for action port [ 795.422650] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84213b0-a32e-49bf-97aa-67c24de8104c with Priority: HIGHEST for action security_group_rules [ 795.422857] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84213b0-a32e-49bf-97aa-67c24de8104c with Priority: HIGHEST for action security_group_members [ 795.422932] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59da7bf8-0d98-4c0a-b680-88d76cf06160 with Priority: HIGHEST for action port [ 795.423154] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e84213b0-a32e-49bf-97aa-67c24de8104c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.424022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.424022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.424468] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.424468] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e84213b0-a32e-49bf-97aa-67c24de8104c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.425109] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84213b0-a32e-49bf-97aa-67c24de8104c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.425538] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.425538] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-59da7bf8-0d98-4c0a-b680-88d76cf06160 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.425538] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59da7bf8-0d98-4c0a-b680-88d76cf06160" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.425691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59da7bf8-0d98-4c0a-b680-88d76cf06160" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.425744] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59da7bf8-0d98-4c0a-b680-88d76cf06160" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.425823] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59da7bf8-0d98-4c0a-b680-88d76cf06160',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.825297] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3: rpc.has_security_group_logging(os_id): False [ 795.848048] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.848226] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.848318] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.848585] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.848705] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.848950] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.849106] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.849210] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.849402] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.849508] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.849730] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.849863] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.849941] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.850137] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.850227] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.850426] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.850548] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.850627] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.850788] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.850885] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.850988] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 is going to be created. [ 795.917842] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.918090] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.918090] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.918290] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.918472] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.929307] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84213b0-a32e-49bf-97aa-67c24de8104c taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.929469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.929629] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 59da7bf8-0d98-4c0a-b680-88d76cf06160 with status ACTIVE [ 795.929940] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.929940] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.930126] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.930185] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.930278] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.930446] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.930532] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.930592] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.930743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.930816] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.931040] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.931096] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.931163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.931274] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.931343] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.931425] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 59da7bf8-0d98-4c0a-b680-88d76cf06160 is going to be updated. [ 795.935080] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 in Status: IN_PROGRESS for 2s [ 795.958073] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.958254] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.958301] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.958502] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.958638] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.958788] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59da7bf8-0d98-4c0a-b680-88d76cf06160" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.242188] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84213b0-a32e-49bf-97aa-67c24de8104c in Status: SUCCESS [ 796.242188] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84213b0-a32e-49bf-97aa-67c24de8104c deletion is rescheduled due to dependency. [ 796.242347] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.242557] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.242969] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.243215] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.243348] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.243413] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.243574] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.243657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.243748] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e84213b0-a32e-49bf-97aa-67c24de8104c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.746519] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e84213b0-a32e-49bf-97aa-67c24de8104c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.252677] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e84213b0-a32e-49bf-97aa-67c24de8104c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.755355] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.755671] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.755782] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.756108] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.756282] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.756409] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84213b0-a32e-49bf-97aa-67c24de8104c is going to be updated. [ 797.789935] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.790253] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.790253] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.790350] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.790508] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.802246] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84213b0-a32e-49bf-97aa-67c24de8104c in Status: IN_PROGRESS for 2s [ 797.953949] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 in Status: SUCCESS [ 797.954296] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.446199] env[70520]: INFO networking_nsxv3.common.synchronization [req-33ff8779-7316-4074-9335-0875a6c80750 req-b8991b20-4f99-43f7-b7a6-c42f57118314 tempest-ServersNegativeTestJSON-641348566 tempest-ServersNegativeTestJSON-641348566-project-member] Enqueued Resource ID: d202bbfa-42d6-4633-985f-b1007599bbf2 with Priority: HIGHEST for action security_group_members [ 798.446199] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d202bbfa-42d6-4633-985f-b1007599bbf2 with Priority: HIGHEST for action security_group_members [ 798.446199] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d202bbfa-42d6-4633-985f-b1007599bbf2 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.446199] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.446199] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.446888] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.446888] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.446964] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.446993] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.447206] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.447294] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.447397] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d202bbfa-42d6-4633-985f-b1007599bbf2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.848543] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-28 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.848956] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-28" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.849170] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-28" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.849580] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-28" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.849937] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.850179] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.850329] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.850589] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.850739] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.850939] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 798.851072] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 798.851176] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 798.851285] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 798.851393] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 798.852242] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 798.852242] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 798.879030] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 798.879030] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 798.879030] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 798.879030] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-28" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.879030] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-21efc286-0a0e-4447-a667-9c5bf1fe5417 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.879030] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-21efc286-0a0e-4447-a667-9c5bf1fe5417" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.879030] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-21efc286-0a0e-4447-a667-9c5bf1fe5417" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.879030] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-21efc286-0a0e-4447-a667-9c5bf1fe5417" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.879030] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21efc286-0a0e-4447-a667-9c5bf1fe5417',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.951769] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.951769] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.951769] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.951769] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.951769] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.951769] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.951769] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.951769] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.951769] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.951769] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.951769] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d202bbfa-42d6-4633-985f-b1007599bbf2 already deleted. [ 798.951769] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.368583] env[70520]: INFO networking_nsxv3.common.synchronization [req-517a01e9-cdaf-4398-985a-4e66d5dc9874 req-8f25f916-a0ab-448a-907b-624ebc301f43 tempest-ServerDiskConfigTestJSON-984450191 tempest-ServerDiskConfigTestJSON-984450191-project-member] Enqueued Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 799.369945] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 799.370767] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.371133] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.371329] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.371827] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.372116] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.373084] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.373084] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.373084] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.373084] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.373084] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.388040] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.388040] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.388040] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.388040] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.388040] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.388040] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 21efc286-0a0e-4447-a667-9c5bf1fe5417 not found, creating... [ 799.388040] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.388040] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.388040] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.388040] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.388040] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.388583] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.388583] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.388583] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.392169] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.392169] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.392568] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 21efc286-0a0e-4447-a667-9c5bf1fe5417 is going to be created. [ 799.417583] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.417839] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.417972] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.418237] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.418929] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.418929] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-21efc286-0a0e-4447-a667-9c5bf1fe5417" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.554341] env[70520]: INFO networking_nsxv3.common.synchronization [req-906610a7-828c-4788-bcf5-b1af9f5d1348 req-ae634a65-7794-481e-9ff1-a4c733824bd6 tempest-ListServersNegativeTestJSON-1140309429 tempest-ListServersNegativeTestJSON-1140309429-project-member] Enqueued Resource ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 with Priority: HIGHEST for action security_group_members [ 799.555265] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 with Priority: HIGHEST for action security_group_members [ 799.555780] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.555925] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.555980] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.556232] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.556408] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.556570] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.556669] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.556905] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.557059] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.557219] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.813620] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84213b0-a32e-49bf-97aa-67c24de8104c in Status: SUCCESS [ 799.813909] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.814168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.814455] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.814746] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.814932] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.815069] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.815316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.815450] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.815594] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.815746] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e84213b0-a32e-49bf-97aa-67c24de8104c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.876127] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.876341] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.876440] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.877178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.877178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.877178] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.877336] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.877961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.877961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.877961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.877961] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 is going to be updated. [ 799.915863] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.916084] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.916191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.916510] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.916702] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.928848] env[70520]: INFO networking_nsxv3.common.synchronization [req-19c58041-b587-456d-87ad-71c48cd4e5fb req-f103503a-47d6-41d4-b581-eb3a3df4dc22 tempest-ListServersNegativeTestJSON-1140309429 tempest-ListServersNegativeTestJSON-1140309429-project-member] Enqueued Resource ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 with Priority: HIGHEST for action security_group_members [ 799.929445] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 with Priority: HIGHEST for action security_group_members [ 799.929746] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.929841] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.932208] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: IN_PROGRESS for 2s [ 800.063244] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.274190] env[70520]: INFO networking_nsxv3.common.synchronization [req-33ff8779-7316-4074-9335-0875a6c80750 req-18df0af1-9817-47ae-8afd-02cccb1c1048 service nova] Enqueued Resource ID: d202bbfa-42d6-4633-985f-b1007599bbf2 with Priority: HIGHEST for action security_group_rules [ 800.274426] env[70520]: INFO networking_nsxv3.common.synchronization [req-33ff8779-7316-4074-9335-0875a6c80750 req-18df0af1-9817-47ae-8afd-02cccb1c1048 service nova] Enqueued Resource ID: d202bbfa-42d6-4633-985f-b1007599bbf2 with Priority: HIGHEST for action security_group_members [ 800.274627] env[70520]: INFO networking_nsxv3.common.synchronization [req-33ff8779-7316-4074-9335-0875a6c80750 req-18df0af1-9817-47ae-8afd-02cccb1c1048 service nova] Enqueued Resource ID: 21efc286-0a0e-4447-a667-9c5bf1fe5417 with Priority: HIGHEST for action port [ 800.276023] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d202bbfa-42d6-4633-985f-b1007599bbf2 with Priority: HIGHEST for action security_group_rules [ 800.276213] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d202bbfa-42d6-4633-985f-b1007599bbf2 with Priority: HIGHEST for action security_group_members [ 800.276420] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21efc286-0a0e-4447-a667-9c5bf1fe5417 with Priority: HIGHEST for action port [ 800.276873] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d202bbfa-42d6-4633-985f-b1007599bbf2 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.277032] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.277134] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.277495] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.277990] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d202bbfa-42d6-4633-985f-b1007599bbf2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.279240] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d202bbfa-42d6-4633-985f-b1007599bbf2 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.281798] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.281798] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.281798] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.281798] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.281798] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.281798] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.281798] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.281798] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.281798] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d202bbfa-42d6-4633-985f-b1007599bbf2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.281798] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-21efc286-0a0e-4447-a667-9c5bf1fe5417 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.282331] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21efc286-0a0e-4447-a667-9c5bf1fe5417" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.282331] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21efc286-0a0e-4447-a667-9c5bf1fe5417" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.282331] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21efc286-0a0e-4447-a667-9c5bf1fe5417" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.282417] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21efc286-0a0e-4447-a667-9c5bf1fe5417',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.319447] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84213b0-a32e-49bf-97aa-67c24de8104c taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.319601] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.319668] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.319871] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.320047] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.320164] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.320227] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.320377] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.320463] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.320547] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.320690] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84213b0-a32e-49bf-97aa-67c24de8104c taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.320782] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.320841] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.320977] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.321127] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.321218] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.321273] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.321407] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.321502] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.321567] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.321643] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e84213b0-a32e-49bf-97aa-67c24de8104c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.566119] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.784803] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d202bbfa-42d6-4633-985f-b1007599bbf2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.786225] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d202bbfa-42d6-4633-985f-b1007599bbf2 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.786352] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.787204] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21efc286-0a0e-4447-a667-9c5bf1fe5417 with status ACTIVE [ 800.787204] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.787204] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.787204] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.787443] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.787443] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.787496] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.788070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.788070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.788070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.788070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.788070] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.788283] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.788283] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.788283] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.788406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.788406] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21efc286-0a0e-4447-a667-9c5bf1fe5417 is going to be updated. [ 800.809618] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.809726] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.809778] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.809985] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.810132] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.810287] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21efc286-0a0e-4447-a667-9c5bf1fe5417" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.824059] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e84213b0-a32e-49bf-97aa-67c24de8104c: rpc.has_security_group_logging(os_id): False [ 800.925076] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.925238] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.925418] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.925642] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.926388] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.926611] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.926735] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.926783] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.926957] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.927149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.927240] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.927334] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.927847] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.927847] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.927847] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.927847] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.927847] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.928015] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.928097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.928126] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.928201] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e84213b0-a32e-49bf-97aa-67c24de8104c is going to be updated. [ 801.024750] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.024934] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.025063] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.025690] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.025690] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.047598] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e84213b0-a32e-49bf-97aa-67c24de8104c in Status: IN_PROGRESS for 2s [ 801.069553] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.069553] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.069553] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.069553] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.069737] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.069826] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 is going to be updated. [ 801.112493] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.112664] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.112717] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.112926] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.113087] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.132258] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 in Status: IN_PROGRESS for 2s [ 801.260609] env[70520]: INFO networking_nsxv3.common.synchronization [req-45d364b8-71db-454a-882c-c83d5d3a118a req-f9d4770b-cab2-4f4d-8297-2f2a94fc3b14 tempest-ImagesOneServerNegativeTestJSON-1115954637 tempest-ImagesOneServerNegativeTestJSON-1115954637-project-member] Enqueued Resource ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad with Priority: HIGHEST for action security_group_members [ 801.261245] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad with Priority: HIGHEST for action security_group_members [ 801.261833] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc3c352-f711-4ecc-9064-0883727ce3ad taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.262081] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.262252] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.262650] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.262829] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.262932] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.262995] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.263278] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.263418] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.263482] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cc3c352-f711-4ecc-9064-0883727ce3ad',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.288650] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d202bbfa-42d6-4633-985f-b1007599bbf2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.644036] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-918 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.644036] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-918" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.644036] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-918" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.644036] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-918" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.644542] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.644542] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.644542] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.644794] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.644990] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.645230] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.645379] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 801.645495] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 801.645601] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 801.645710] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.645812] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 801.645942] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 801.670045] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 801.670045] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 801.670045] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 801.670045] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-918" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.670344] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-ec0e66fa-65df-4bc2-8e45-edc74588a6bc taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.670434] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-ec0e66fa-65df-4bc2-8e45-edc74588a6bc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.670546] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-ec0e66fa-65df-4bc2-8e45-edc74588a6bc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.670922] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-ec0e66fa-65df-4bc2-8e45-edc74588a6bc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.671111] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec0e66fa-65df-4bc2-8e45-edc74588a6bc',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.766028] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.766197] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.766260] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.766532] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.766664] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.766824] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.766917] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.766975] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.767146] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.767218] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.767312] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad already deleted. [ 801.767435] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.791635] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.791857] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.791904] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.792349] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.792461] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.792567] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d202bbfa-42d6-4633-985f-b1007599bbf2 is going to be created. [ 801.821126] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.821284] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.821344] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.821551] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.821712] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.840615] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d202bbfa-42d6-4633-985f-b1007599bbf2 in Status: UNINITIALIZED for 2s [ 801.946979] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: SUCCESS [ 801.947222] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 deletion is rescheduled due to dependency. [ 801.947341] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.173487] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.173740] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.173842] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.174199] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.174363] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.174638] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port ec0e66fa-65df-4bc2-8e45-edc74588a6bc not found, creating... [ 802.175122] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.175241] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.175453] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.176153] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.176153] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.176153] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.176400] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.176457] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.176689] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.176832] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.176975] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: ec0e66fa-65df-4bc2-8e45-edc74588a6bc is going to be created. [ 802.199691] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.199947] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.200085] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.200634] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.200893] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.201142] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-ec0e66fa-65df-4bc2-8e45-edc74588a6bc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.890546] env[70520]: INFO networking_nsxv3.common.synchronization [req-45d364b8-71db-454a-882c-c83d5d3a118a req-6d1143db-3dfa-4983-a214-8824a4985076 service nova] Enqueued Resource ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad with Priority: HIGHEST for action security_group_rules [ 802.890821] env[70520]: INFO networking_nsxv3.common.synchronization [req-45d364b8-71db-454a-882c-c83d5d3a118a req-6d1143db-3dfa-4983-a214-8824a4985076 service nova] Enqueued Resource ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad with Priority: HIGHEST for action security_group_members [ 802.890862] env[70520]: INFO networking_nsxv3.common.synchronization [req-45d364b8-71db-454a-882c-c83d5d3a118a req-6d1143db-3dfa-4983-a214-8824a4985076 service nova] Enqueued Resource ID: ec0e66fa-65df-4bc2-8e45-edc74588a6bc with Priority: HIGHEST for action port [ 802.891366] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad with Priority: HIGHEST for action security_group_rules [ 802.891516] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad with Priority: HIGHEST for action security_group_members [ 802.891632] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec0e66fa-65df-4bc2-8e45-edc74588a6bc with Priority: HIGHEST for action port [ 802.891853] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cc3c352-f711-4ecc-9064-0883727ce3ad taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.891989] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.892477] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.892711] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.892744] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cc3c352-f711-4ecc-9064-0883727ce3ad',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.893798] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc3c352-f711-4ecc-9064-0883727ce3ad taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.893995] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.893995] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.894622] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.894622] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.894622] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.894622] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.894622] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.894971] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.894971] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cc3c352-f711-4ecc-9064-0883727ce3ad',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.896273] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec0e66fa-65df-4bc2-8e45-edc74588a6bc taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.896273] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec0e66fa-65df-4bc2-8e45-edc74588a6bc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.896273] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec0e66fa-65df-4bc2-8e45-edc74588a6bc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.897996] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec0e66fa-65df-4bc2-8e45-edc74588a6bc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.897996] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec0e66fa-65df-4bc2-8e45-edc74588a6bc',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.061389] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e84213b0-a32e-49bf-97aa-67c24de8104c in Status: SUCCESS [ 803.061677] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.143516] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 in Status: SUCCESS [ 803.143712] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.143949] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.144194] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.145086] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.145086] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.145086] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.145086] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.145086] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.145086] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.244302] env[70520]: INFO networking_nsxv3.common.synchronization [req-7332c471-086a-4c6e-9d54-8280b29d511d req-d0c2c654-9005-48b2-aeec-ffe80f9d7cc5 tempest-ServerGroupTestJSON-99871040 tempest-ServerGroupTestJSON-99871040-project-member] Enqueued Resource ID: 1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 with Priority: HIGHEST for action security_group_members [ 803.244828] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 with Priority: HIGHEST for action security_group_members [ 803.245762] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.245762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.245762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.245762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.245950] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.245992] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.246036] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.246181] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.246261] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.246349] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.398827] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3cc3c352-f711-4ecc-9064-0883727ce3ad',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.399686] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc3c352-f711-4ecc-9064-0883727ce3ad taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.399820] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.400163] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ec0e66fa-65df-4bc2-8e45-edc74588a6bc with status ACTIVE [ 803.400315] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.400419] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.400492] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.400699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.400783] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.400951] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.401066] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.401407] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.401407] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.401407] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.401604] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.401604] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.401724] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.401752] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.401823] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.401914] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ec0e66fa-65df-4bc2-8e45-edc74588a6bc is going to be updated. [ 803.423909] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.423909] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.423909] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.423909] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.423909] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.424176] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec0e66fa-65df-4bc2-8e45-edc74588a6bc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.647983] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.648635] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.648759] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.649027] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.649128] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.649339] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.649451] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.649512] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.649668] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.649743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.649835] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 is going to be updated. [ 803.676552] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.676674] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.678231] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.678231] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.678231] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.687734] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 in Status: IN_PROGRESS for 2s [ 803.749236] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.749431] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.749509] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.749783] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.749937] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.750180] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.750340] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.750435] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.750629] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.750709] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.750800] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 is going to be updated. [ 803.779292] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.779464] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.779500] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.779747] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.779829] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.788471] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 in Status: IN_PROGRESS for 2s [ 803.849381] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d202bbfa-42d6-4633-985f-b1007599bbf2 in Status: SUCCESS [ 803.849587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.849754] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.849975] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.850177] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.850291] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.850357] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.850506] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.850583] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.850665] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.850752] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d202bbfa-42d6-4633-985f-b1007599bbf2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.901457] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3cc3c352-f711-4ecc-9064-0883727ce3ad',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.352950] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d202bbfa-42d6-4633-985f-b1007599bbf2 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.353118] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.353195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.353424] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.353595] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.353693] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.353763] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.353897] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.353981] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.354076] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.354240] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d202bbfa-42d6-4633-985f-b1007599bbf2 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.354349] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.354349] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.354477] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.354774] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.354774] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.354774] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.354931] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.354960] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.356892] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.356892] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d202bbfa-42d6-4633-985f-b1007599bbf2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.404288] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.404469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.404536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.404737] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.404836] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.404933] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad is going to be created. [ 804.428601] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.428772] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.428825] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.429042] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.429952] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.455376] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad in Status: UNINITIALIZED for 2s [ 804.860399] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d202bbfa-42d6-4633-985f-b1007599bbf2: rpc.has_security_group_logging(os_id): False [ 804.900543] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.900543] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.900543] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.900543] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.900543] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.900990] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.900990] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.900990] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.900990] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.901171] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.901200] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.901557] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.901557] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.901557] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.901557] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.901855] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.901855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.901855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.901964] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.902107] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.902206] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d202bbfa-42d6-4633-985f-b1007599bbf2 is going to be created. [ 804.985394] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.985394] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.985575] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.985675] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.986192] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.000078] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d202bbfa-42d6-4633-985f-b1007599bbf2 in Status: IN_PROGRESS for 2s [ 805.699829] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 in Status: SUCCESS [ 805.700039] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 deletion is rescheduled due to dependency. [ 805.700155] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.800611] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 in Status: SUCCESS [ 805.800787] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 deletion is rescheduled due to dependency. [ 805.800901] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.469979] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad in Status: SUCCESS [ 806.470316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.470418] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.470640] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.470869] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.470994] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.471072] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.471255] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.471338] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.471424] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.471519] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3cc3c352-f711-4ecc-9064-0883727ce3ad',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.778606] env[70520]: INFO networking_nsxv3.common.synchronization [req-9856b987-54b4-4768-a928-cdea1ca9e966 req-a9496c32-e2c3-4896-b928-dfa262a38d06 tempest-FloatingIPsAssociationTestJSON-847223640 tempest-FloatingIPsAssociationTestJSON-847223640-project-member] Enqueued Resource ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 with Priority: HIGHEST for action security_group_members [ 806.779364] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 with Priority: HIGHEST for action security_group_members [ 806.779728] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-22824640-0730-4b9a-a9ef-9014ef216bc4 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.779860] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.779928] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.783379] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.783598] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.783723] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.783851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.784060] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.784148] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.784247] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22824640-0730-4b9a-a9ef-9014ef216bc4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.976553] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc3c352-f711-4ecc-9064-0883727ce3ad taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.976687] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.976754] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.976968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.977150] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.977333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.977333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.977457] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.977544] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.977656] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.977863] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc3c352-f711-4ecc-9064-0883727ce3ad taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.977959] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.978143] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.978296] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.978432] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.978525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.978573] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.978716] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.978786] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.978864] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.978949] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3cc3c352-f711-4ecc-9064-0883727ce3ad',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.013369] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d202bbfa-42d6-4633-985f-b1007599bbf2 in Status: SUCCESS [ 807.013655] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.286496] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.286694] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.286760] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.287321] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.287321] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.287415] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.287466] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.287496] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.287639] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.287733] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.287830] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 is going to be updated. [ 807.323470] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.323652] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.323689] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.323911] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.324019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.340209] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 in Status: IN_PROGRESS for 2s [ 807.482478] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3cc3c352-f711-4ecc-9064-0883727ce3ad: rpc.has_security_group_logging(os_id): False [ 807.511019] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.511191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.511280] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.511552] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.511660] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.511923] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.512080] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.512171] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.512395] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.512502] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.512782] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.512908] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.512994] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.513465] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.513577] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.513821] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.513946] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.514042] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.514234] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.514332] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.514447] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad is going to be created. [ 807.539422] env[70520]: INFO networking_nsxv3.common.synchronization [req-118f2f0e-c5aa-473d-b3ed-016aa39660d9 req-65a23184-d59e-4254-bf83-44440191bde9 tempest-DeleteServersAdminTestJSON-1646148384 tempest-DeleteServersAdminTestJSON-1646148384-project-member] Enqueued Resource ID: e84213b0-a32e-49bf-97aa-67c24de8104c with Priority: HIGHEST for action security_group_members [ 807.539422] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84213b0-a32e-49bf-97aa-67c24de8104c with Priority: HIGHEST for action security_group_members [ 807.539422] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84213b0-a32e-49bf-97aa-67c24de8104c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.539422] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.539422] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.539422] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.539422] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.539422] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.539422] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.540047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.540225] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.540395] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e84213b0-a32e-49bf-97aa-67c24de8104c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.593571] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.596021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.596021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.596021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.596021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.619128] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad in Status: IN_PROGRESS for 2s [ 808.043543] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.043732] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.043732] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.043881] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.043964] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.044170] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.044262] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.044311] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.044459] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.044533] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.044613] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84213b0-a32e-49bf-97aa-67c24de8104c is going to be updated. [ 808.075588] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.075734] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.075734] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.075901] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.076057] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.086413] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84213b0-a32e-49bf-97aa-67c24de8104c in Status: IN_PROGRESS for 2s [ 808.547290] env[70520]: INFO networking_nsxv3.common.synchronization [req-51ad6e96-55b8-4f91-8ea0-97ae3b76f00a req-90c3728f-f3a5-48b6-ba01-21fe607eab4d tempest-ServerMetadataNegativeTestJSON-1722094476 tempest-ServerMetadataNegativeTestJSON-1722094476-project-member] Enqueued Resource ID: 89cb747a-f330-415b-bfd6-17be7d8807fb with Priority: HIGHEST for action security_group_members [ 808.547650] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89cb747a-f330-415b-bfd6-17be7d8807fb with Priority: HIGHEST for action security_group_members [ 808.548036] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-89cb747a-f330-415b-bfd6-17be7d8807fb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.548139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89cb747a-f330-415b-bfd6-17be7d8807fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.548201] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89cb747a-f330-415b-bfd6-17be7d8807fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.548434] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89cb747a-f330-415b-bfd6-17be7d8807fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.548595] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.548696] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.548833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.548909] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.548998] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.549490] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89cb747a-f330-415b-bfd6-17be7d8807fb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.045127] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-817 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.045452] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-817" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.045782] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-817" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.046922] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-817" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.048080] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.048468] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.048649] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.048964] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.049273] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.050016] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 809.050176] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 809.050352] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 809.050465] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 809.050601] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 809.050728] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 809.050933] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 809.052583] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.052704] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.053097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.053392] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.053485] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.053780] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.053930] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.054016] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.054603] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.054603] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.054701] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89cb747a-f330-415b-bfd6-17be7d8807fb already deleted. [ 809.054782] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89cb747a-f330-415b-bfd6-17be7d8807fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.075948] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 809.075948] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 809.075948] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 809.075948] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-817" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.075948] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-9d954c0a-0f23-494a-b61a-6ffcf12e6d5c taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.075948] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-9d954c0a-0f23-494a-b61a-6ffcf12e6d5c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.075948] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-9d954c0a-0f23-494a-b61a-6ffcf12e6d5c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.075948] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-9d954c0a-0f23-494a-b61a-6ffcf12e6d5c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.076373] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d954c0a-0f23-494a-b61a-6ffcf12e6d5c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.349177] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 in Status: SUCCESS [ 809.349395] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22824640-0730-4b9a-a9ef-9014ef216bc4 deletion is rescheduled due to dependency. [ 809.349614] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22824640-0730-4b9a-a9ef-9014ef216bc4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.578893] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.579298] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.579387] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.579771] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.580105] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.580334] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 9d954c0a-0f23-494a-b61a-6ffcf12e6d5c not found, creating... [ 809.580714] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.580966] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.581187] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.581462] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.581708] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.581999] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.582256] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.582424] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.582679] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.582868] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.583063] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 9d954c0a-0f23-494a-b61a-6ffcf12e6d5c is going to be created. [ 809.609035] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.609403] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.609587] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.609908] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.610252] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.610455] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-9d954c0a-0f23-494a-b61a-6ffcf12e6d5c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.635111] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad in Status: SUCCESS [ 809.635334] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.097741] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84213b0-a32e-49bf-97aa-67c24de8104c in Status: SUCCESS [ 810.097741] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84213b0-a32e-49bf-97aa-67c24de8104c deletion is rescheduled due to dependency. [ 810.098019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.698592] env[70520]: INFO networking_nsxv3.common.synchronization [req-51ad6e96-55b8-4f91-8ea0-97ae3b76f00a req-2cc23c60-393a-4ca7-a7bf-5965858403e3 service nova] Enqueued Resource ID: 89cb747a-f330-415b-bfd6-17be7d8807fb with Priority: HIGHEST for action security_group_rules [ 810.698867] env[70520]: INFO networking_nsxv3.common.synchronization [req-51ad6e96-55b8-4f91-8ea0-97ae3b76f00a req-2cc23c60-393a-4ca7-a7bf-5965858403e3 service nova] Enqueued Resource ID: 89cb747a-f330-415b-bfd6-17be7d8807fb with Priority: HIGHEST for action security_group_members [ 810.698905] env[70520]: INFO networking_nsxv3.common.synchronization [req-51ad6e96-55b8-4f91-8ea0-97ae3b76f00a req-2cc23c60-393a-4ca7-a7bf-5965858403e3 service nova] Enqueued Resource ID: 9d954c0a-0f23-494a-b61a-6ffcf12e6d5c with Priority: HIGHEST for action port [ 810.699146] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89cb747a-f330-415b-bfd6-17be7d8807fb with Priority: HIGHEST for action security_group_rules [ 810.699275] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89cb747a-f330-415b-bfd6-17be7d8807fb with Priority: HIGHEST for action security_group_members [ 810.699369] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d954c0a-0f23-494a-b61a-6ffcf12e6d5c with Priority: HIGHEST for action port [ 810.699943] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89cb747a-f330-415b-bfd6-17be7d8807fb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.700183] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89cb747a-f330-415b-bfd6-17be7d8807fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.700277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89cb747a-f330-415b-bfd6-17be7d8807fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.700541] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89cb747a-f330-415b-bfd6-17be7d8807fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.700640] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89cb747a-f330-415b-bfd6-17be7d8807fb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.701575] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-89cb747a-f330-415b-bfd6-17be7d8807fb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.701719] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89cb747a-f330-415b-bfd6-17be7d8807fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.701787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89cb747a-f330-415b-bfd6-17be7d8807fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.701971] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89cb747a-f330-415b-bfd6-17be7d8807fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.702147] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.702245] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.702307] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.702451] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.702534] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.702624] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89cb747a-f330-415b-bfd6-17be7d8807fb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.708093] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d954c0a-0f23-494a-b61a-6ffcf12e6d5c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.708301] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d954c0a-0f23-494a-b61a-6ffcf12e6d5c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.708374] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d954c0a-0f23-494a-b61a-6ffcf12e6d5c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.708591] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d954c0a-0f23-494a-b61a-6ffcf12e6d5c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.708678] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d954c0a-0f23-494a-b61a-6ffcf12e6d5c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.210866] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('89cb747a-f330-415b-bfd6-17be7d8807fb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.211944] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-89cb747a-f330-415b-bfd6-17be7d8807fb taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.216197] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89cb747a-f330-415b-bfd6-17be7d8807fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.216801] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9d954c0a-0f23-494a-b61a-6ffcf12e6d5c with status ACTIVE [ 811.217030] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.217158] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.217224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.217445] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.217527] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.217710] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.217807] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.217865] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.218019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.218095] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.218269] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.218356] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.218413] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.218546] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.218614] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.218692] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9d954c0a-0f23-494a-b61a-6ffcf12e6d5c is going to be updated. [ 811.245319] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.245497] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.245574] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.246232] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.246232] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.249245] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d954c0a-0f23-494a-b61a-6ffcf12e6d5c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.718614] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('89cb747a-f330-415b-bfd6-17be7d8807fb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.865815] env[70520]: INFO networking_nsxv3.common.synchronization [req-4eea9d58-779d-4394-984e-7676c08d801d req-e0fe1600-f4c3-4bbc-b3f0-d249479c3874 tempest-ListImageFiltersTestJSON-785679465 tempest-ListImageFiltersTestJSON-785679465-project-member] Enqueued Resource ID: ada31481-82b9-4792-af47-296d5fe27a9f with Priority: HIGHEST for action security_group_members [ 811.867038] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ada31481-82b9-4792-af47-296d5fe27a9f with Priority: HIGHEST for action security_group_members [ 811.867038] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada31481-82b9-4792-af47-296d5fe27a9f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.867038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.867038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.868219] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.868219] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.868219] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.868219] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.868219] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.868219] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.870111] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ada31481-82b9-4792-af47-296d5fe27a9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.162195] env[70520]: INFO networking_nsxv3.common.synchronization [None req-9832bd86-a36b-4b17-874d-60d645e4e48b None None] Enqueued Resource ID: a9c622e8-18b9-4aba-9838-28e5b3f8a46e with Priority: HIGHEST for action port [ 812.162484] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9c622e8-18b9-4aba-9838-28e5b3f8a46e with Priority: HIGHEST for action port [ 812.164417] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9c622e8-18b9-4aba-9838-28e5b3f8a46e taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.164417] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9c622e8-18b9-4aba-9838-28e5b3f8a46e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.164417] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9c622e8-18b9-4aba-9838-28e5b3f8a46e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.165988] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9c622e8-18b9-4aba-9838-28e5b3f8a46e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.166103] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9c622e8-18b9-4aba-9838-28e5b3f8a46e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.227987] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.228171] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.228243] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.228546] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.228637] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.228736] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89cb747a-f330-415b-bfd6-17be7d8807fb is going to be created. [ 812.253775] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.253927] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.254043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.254208] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.254792] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.268833] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89cb747a-f330-415b-bfd6-17be7d8807fb in Status: UNINITIALIZED for 2s [ 812.358096] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-659 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.358298] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.358413] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.358678] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.358930] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.359502] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.359682] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.360238] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.360238] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.360366] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 812.360459] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 812.360585] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 812.360703] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 812.360914] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 812.361067] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 812.362799] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 812.372450] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.372554] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.372554] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.372739] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.372828] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.373027] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.373126] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.373186] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.374037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.374037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.374037] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ada31481-82b9-4792-af47-296d5fe27a9f already deleted. [ 812.374037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.384883] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 812.385054] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 812.385196] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 812.385402] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.385753] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-c6495146-3a01-45fb-a9cd-048d06f9648e taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.385920] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-c6495146-3a01-45fb-a9cd-048d06f9648e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.386046] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-c6495146-3a01-45fb-a9cd-048d06f9648e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.386366] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-c6495146-3a01-45fb-a9cd-048d06f9648e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.386537] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6495146-3a01-45fb-a9cd-048d06f9648e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.669154] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9c622e8-18b9-4aba-9838-28e5b3f8a46e [ 812.670431] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.670572] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.670694] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.670915] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.670990] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.671116] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9c622e8-18b9-4aba-9838-28e5b3f8a46e already deleted. [ 812.671201] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9c622e8-18b9-4aba-9838-28e5b3f8a46e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.890912] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.891245] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.891327] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.891638] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.891998] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.892235] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port c6495146-3a01-45fb-a9cd-048d06f9648e not found, creating... [ 812.892751] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.893121] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.893346] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.893678] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.893901] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.894264] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.894496] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.894660] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.895088] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.895315] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.895535] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: c6495146-3a01-45fb-a9cd-048d06f9648e is going to be created. [ 812.924199] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.924199] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.924376] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.924546] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.924768] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.924986] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-c6495146-3a01-45fb-a9cd-048d06f9648e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.374866] env[70520]: INFO networking_nsxv3.common.synchronization [None req-93ad49a0-1838-4d16-af31-563a02b2f2d0 tempest-ServersTestManualDisk-1453882973 tempest-ServersTestManualDisk-1453882973-project-member] Enqueued Resource ID: 7c9dafc4-e7ff-4514-ba35-e91b76e57256 with Priority: HIGHEST for action security_group_rules [ 813.375868] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c9dafc4-e7ff-4514-ba35-e91b76e57256 with Priority: HIGHEST for action security_group_rules [ 813.376077] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c9dafc4-e7ff-4514-ba35-e91b76e57256 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.376209] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c9dafc4-e7ff-4514-ba35-e91b76e57256" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.376273] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c9dafc4-e7ff-4514-ba35-e91b76e57256" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.376609] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c9dafc4-e7ff-4514-ba35-e91b76e57256" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.376704] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c9dafc4-e7ff-4514-ba35-e91b76e57256',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.484859] env[70520]: INFO networking_nsxv3.common.synchronization [None req-bca5ef53-4026-4d1a-b264-5d3ed4327270 tempest-ServersTestManualDisk-1453882973 tempest-ServersTestManualDisk-1453882973-project-member] Enqueued Resource ID: 7c9dafc4-e7ff-4514-ba35-e91b76e57256 with Priority: HIGHEST for action security_group_rules [ 813.485442] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c9dafc4-e7ff-4514-ba35-e91b76e57256 with Priority: HIGHEST for action security_group_rules [ 813.485750] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c9dafc4-e7ff-4514-ba35-e91b76e57256 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.485857] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c9dafc4-e7ff-4514-ba35-e91b76e57256" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.809371] env[70520]: INFO networking_nsxv3.common.synchronization [req-4eea9d58-779d-4394-984e-7676c08d801d req-d7d84481-dd04-4034-bc17-f8e5c4d52d37 service nova] Enqueued Resource ID: ada31481-82b9-4792-af47-296d5fe27a9f with Priority: HIGHEST for action security_group_rules [ 813.810504] env[70520]: INFO networking_nsxv3.common.synchronization [req-4eea9d58-779d-4394-984e-7676c08d801d req-d7d84481-dd04-4034-bc17-f8e5c4d52d37 service nova] Enqueued Resource ID: ada31481-82b9-4792-af47-296d5fe27a9f with Priority: HIGHEST for action security_group_members [ 813.810504] env[70520]: INFO networking_nsxv3.common.synchronization [req-4eea9d58-779d-4394-984e-7676c08d801d req-d7d84481-dd04-4034-bc17-f8e5c4d52d37 service nova] Enqueued Resource ID: c6495146-3a01-45fb-a9cd-048d06f9648e with Priority: HIGHEST for action port [ 813.810504] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ada31481-82b9-4792-af47-296d5fe27a9f with Priority: HIGHEST for action security_group_rules [ 813.810504] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ada31481-82b9-4792-af47-296d5fe27a9f with Priority: HIGHEST for action security_group_members [ 813.810504] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6495146-3a01-45fb-a9cd-048d06f9648e with Priority: HIGHEST for action port [ 813.810733] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ada31481-82b9-4792-af47-296d5fe27a9f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.810838] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.811050] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.811743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.812607] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ada31481-82b9-4792-af47-296d5fe27a9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.817041] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada31481-82b9-4792-af47-296d5fe27a9f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.817041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.817041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.817041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.817041] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.817041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.817041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.817041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.817041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.817041] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ada31481-82b9-4792-af47-296d5fe27a9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.819824] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6495146-3a01-45fb-a9cd-048d06f9648e taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.823123] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6495146-3a01-45fb-a9cd-048d06f9648e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.823123] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6495146-3a01-45fb-a9cd-048d06f9648e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.823123] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6495146-3a01-45fb-a9cd-048d06f9648e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.823123] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6495146-3a01-45fb-a9cd-048d06f9648e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.899694] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.899694] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.899694] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.900113] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.900113] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.900113] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c9dafc4-e7ff-4514-ba35-e91b76e57256 already deleted. [ 813.900113] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c9dafc4-e7ff-4514-ba35-e91b76e57256" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.900268] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c9dafc4-e7ff-4514-ba35-e91b76e57256" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.900414] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c9dafc4-e7ff-4514-ba35-e91b76e57256" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.900497] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c9dafc4-e7ff-4514-ba35-e91b76e57256',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.181064] env[70520]: INFO networking_nsxv3.common.synchronization [None req-e7e5bc1a-0f3c-49f2-92fc-74a565abbc5e None None] Enqueued Resource ID: c7a4263d-548c-4373-b618-40dcf814f83b with Priority: HIGHEST for action port [ 814.182025] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7a4263d-548c-4373-b618-40dcf814f83b with Priority: HIGHEST for action port [ 814.182357] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7a4263d-548c-4373-b618-40dcf814f83b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.182487] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7a4263d-548c-4373-b618-40dcf814f83b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.182595] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7a4263d-548c-4373-b618-40dcf814f83b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.182849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7a4263d-548c-4373-b618-40dcf814f83b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.182890] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7a4263d-548c-4373-b618-40dcf814f83b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.282716] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89cb747a-f330-415b-bfd6-17be7d8807fb in Status: SUCCESS [ 814.283458] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89cb747a-f330-415b-bfd6-17be7d8807fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.284301] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89cb747a-f330-415b-bfd6-17be7d8807fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.284528] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89cb747a-f330-415b-bfd6-17be7d8807fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.284748] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.287018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.287018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.287018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.287018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.287018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89cb747a-f330-415b-bfd6-17be7d8807fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.287018] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('89cb747a-f330-415b-bfd6-17be7d8807fb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.320244] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ada31481-82b9-4792-af47-296d5fe27a9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.326022] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6495146-3a01-45fb-a9cd-048d06f9648e with status ACTIVE [ 814.326022] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.326022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.326022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.326022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.326022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.326022] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.326022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.326022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.326022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.326022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.326022] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.326022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.326022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.326022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.326022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.326022] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6495146-3a01-45fb-a9cd-048d06f9648e is going to be updated. [ 814.328603] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada31481-82b9-4792-af47-296d5fe27a9f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.328948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.354400] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.355195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.355195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.355195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.355195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.355385] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6495146-3a01-45fb-a9cd-048d06f9648e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.436935] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.437154] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.437280] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.437561] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.438691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.438691] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c9dafc4-e7ff-4514-ba35-e91b76e57256 already deleted. [ 814.438691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c9dafc4-e7ff-4514-ba35-e91b76e57256" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.686807] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c7a4263d-548c-4373-b618-40dcf814f83b [ 814.686807] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.686807] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.686807] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.687131] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.687202] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.687314] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c7a4263d-548c-4373-b618-40dcf814f83b already deleted. [ 814.687395] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7a4263d-548c-4373-b618-40dcf814f83b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.791122] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-89cb747a-f330-415b-bfd6-17be7d8807fb taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.791122] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89cb747a-f330-415b-bfd6-17be7d8807fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.791122] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89cb747a-f330-415b-bfd6-17be7d8807fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.791122] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89cb747a-f330-415b-bfd6-17be7d8807fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.792021] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.792021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.792021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.792265] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.792399] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.792527] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89cb747a-f330-415b-bfd6-17be7d8807fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.792731] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-89cb747a-f330-415b-bfd6-17be7d8807fb taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.792834] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89cb747a-f330-415b-bfd6-17be7d8807fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.792895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89cb747a-f330-415b-bfd6-17be7d8807fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.793051] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89cb747a-f330-415b-bfd6-17be7d8807fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.793186] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.793277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.793335] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.793470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.793548] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.793628] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89cb747a-f330-415b-bfd6-17be7d8807fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.793736] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('89cb747a-f330-415b-bfd6-17be7d8807fb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.823870] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ada31481-82b9-4792-af47-296d5fe27a9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.296870] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 89cb747a-f330-415b-bfd6-17be7d8807fb: rpc.has_security_group_logging(os_id): False [ 815.316820] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.316887] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.316932] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.317192] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.317288] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.317554] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.317648] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.317757] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.317864] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.317941] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.318170] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.318268] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.318328] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.318473] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.318571] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.318850] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.318922] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.318922] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.319101] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.319185] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.319270] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89cb747a-f330-415b-bfd6-17be7d8807fb is going to be created. [ 815.326790] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.326904] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.328124] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.328124] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.328124] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.328124] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ada31481-82b9-4792-af47-296d5fe27a9f is going to be created. [ 815.352152] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.352330] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.352402] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.352574] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.352735] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.364566] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ada31481-82b9-4792-af47-296d5fe27a9f in Status: UNINITIALIZED for 2s [ 815.390211] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.390364] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.390409] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.390963] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.390963] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.404376] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89cb747a-f330-415b-bfd6-17be7d8807fb in Status: IN_PROGRESS for 2s [ 816.521720] env[70520]: INFO networking_nsxv3.common.synchronization [req-d6c22d20-a7ef-48bd-a8ac-53267e1227ee req-fb1227ce-af8f-499b-a2bf-85ae54036e4b tempest-ListImageFiltersTestJSON-785679465 tempest-ListImageFiltersTestJSON-785679465-project-member] Enqueued Resource ID: ada31481-82b9-4792-af47-296d5fe27a9f with Priority: HIGHEST for action security_group_members [ 816.522407] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ada31481-82b9-4792-af47-296d5fe27a9f with Priority: HIGHEST for action security_group_members [ 816.522725] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada31481-82b9-4792-af47-296d5fe27a9f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.522816] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.616994] env[70520]: INFO networking_nsxv3.common.synchronization [req-70355140-6b62-45a3-92c3-98eb775ab222 req-ac9e9402-bc68-4a0b-bb77-85794d3e2da5 tempest-ServersAdminNegativeTestJSON-263885956 tempest-ServersAdminNegativeTestJSON-263885956-project-member] Enqueued Resource ID: 5ba096e8-0990-4301-b10d-dee4aea7793e with Priority: HIGHEST for action security_group_members [ 816.617706] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ba096e8-0990-4301-b10d-dee4aea7793e with Priority: HIGHEST for action security_group_members [ 816.618500] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ba096e8-0990-4301-b10d-dee4aea7793e taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.618698] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.619687] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.619687] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.619687] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.619687] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.619687] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.619687] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.620046] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.620211] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ba096e8-0990-4301-b10d-dee4aea7793e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.968234] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-659 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.968407] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.968934] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.969358] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.969676] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.969850] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.969981] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.970321] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.970497] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.970734] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 816.970870] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 816.970980] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 816.971097] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 816.971227] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 816.971431] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 816.971497] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 816.995197] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 816.997017] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 816.997017] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 816.997017] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.997017] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-1177107d-489f-423e-bea6-2167ec3c608d taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.997687] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-1177107d-489f-423e-bea6-2167ec3c608d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.998145] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-1177107d-489f-423e-bea6-2167ec3c608d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.998839] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-1177107d-489f-423e-bea6-2167ec3c608d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.999484] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1177107d-489f-423e-bea6-2167ec3c608d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.125399] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.125675] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.125758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.125959] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.126066] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.126265] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.126361] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.126498] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.126699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.126778] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.126846] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ba096e8-0990-4301-b10d-dee4aea7793e is going to be updated. [ 817.159349] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.159553] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.159553] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.159740] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.159884] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.170309] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ba096e8-0990-4301-b10d-dee4aea7793e in Status: IN_PROGRESS for 2s [ 817.375380] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ada31481-82b9-4792-af47-296d5fe27a9f in Status: SUCCESS [ 817.375846] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.375979] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.376199] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.376419] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.376571] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.376662] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.376929] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.376975] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.377066] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.377163] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ada31481-82b9-4792-af47-296d5fe27a9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.378032] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.378199] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.378369] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.378475] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.378542] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.378671] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.378748] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.378836] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ada31481-82b9-4792-af47-296d5fe27a9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.417566] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89cb747a-f330-415b-bfd6-17be7d8807fb in Status: SUCCESS [ 817.418137] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89cb747a-f330-415b-bfd6-17be7d8807fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.502865] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.502865] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.502865] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.503130] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.503240] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.503488] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 1177107d-489f-423e-bea6-2167ec3c608d not found, creating... [ 817.503875] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.504074] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.504314] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.504663] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.504943] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.505375] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.505591] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.505747] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.506029] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.506169] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.506390] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 1177107d-489f-423e-bea6-2167ec3c608d is going to be created. [ 817.547217] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.547619] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.547619] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.547910] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.548205] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.548477] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-1177107d-489f-423e-bea6-2167ec3c608d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.880723] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada31481-82b9-4792-af47-296d5fe27a9f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.880978] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.884466] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ada31481-82b9-4792-af47-296d5fe27a9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.388332] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ada31481-82b9-4792-af47-296d5fe27a9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.745340] env[70520]: INFO networking_nsxv3.common.synchronization [req-d6c22d20-a7ef-48bd-a8ac-53267e1227ee req-3f302767-628c-4e31-8439-81a1b0c2f3f4 service nova] Enqueued Resource ID: ada31481-82b9-4792-af47-296d5fe27a9f with Priority: HIGHEST for action security_group_rules [ 818.745340] env[70520]: INFO networking_nsxv3.common.synchronization [req-d6c22d20-a7ef-48bd-a8ac-53267e1227ee req-3f302767-628c-4e31-8439-81a1b0c2f3f4 service nova] Enqueued Resource ID: ada31481-82b9-4792-af47-296d5fe27a9f with Priority: HIGHEST for action security_group_members [ 818.745340] env[70520]: INFO networking_nsxv3.common.synchronization [req-d6c22d20-a7ef-48bd-a8ac-53267e1227ee req-3f302767-628c-4e31-8439-81a1b0c2f3f4 service nova] Enqueued Resource ID: 1177107d-489f-423e-bea6-2167ec3c608d with Priority: HIGHEST for action port [ 818.745340] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ada31481-82b9-4792-af47-296d5fe27a9f with Priority: HIGHEST for action security_group_rules [ 818.746983] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ada31481-82b9-4792-af47-296d5fe27a9f with Priority: HIGHEST for action security_group_members [ 818.747395] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1177107d-489f-423e-bea6-2167ec3c608d with Priority: HIGHEST for action port [ 818.748274] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ada31481-82b9-4792-af47-296d5fe27a9f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.749254] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.753199] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada31481-82b9-4792-af47-296d5fe27a9f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.753199] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.753199] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-1177107d-489f-423e-bea6-2167ec3c608d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.753199] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1177107d-489f-423e-bea6-2167ec3c608d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.753199] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1177107d-489f-423e-bea6-2167ec3c608d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.753199] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1177107d-489f-423e-bea6-2167ec3c608d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.753199] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1177107d-489f-423e-bea6-2167ec3c608d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.782500] env[70520]: INFO networking_nsxv3.common.synchronization [req-b1251973-3ca7-44ee-9046-1e1bee7a50a6 req-cf0df2f4-8117-472d-84ed-0f2023d085de tempest-ServersTestJSON-2073228387 tempest-ServersTestJSON-2073228387-project-member] Enqueued Resource ID: 49148979-263a-4c7a-a007-bfce9aaa037b with Priority: HIGHEST for action security_group_members [ 818.784637] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49148979-263a-4c7a-a007-bfce9aaa037b with Priority: HIGHEST for action security_group_members [ 818.784637] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-49148979-263a-4c7a-a007-bfce9aaa037b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.784858] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.784987] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.785217] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.785443] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.785641] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.785759] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.785973] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.786393] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.786393] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49148979-263a-4c7a-a007-bfce9aaa037b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.894617] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.894820] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.894944] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.895661] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.895661] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.895661] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ada31481-82b9-4792-af47-296d5fe27a9f is going to be updated. [ 818.929311] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.929475] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.929542] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.929758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.929949] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.943123] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ada31481-82b9-4792-af47-296d5fe27a9f in Status: IN_PROGRESS for 2s [ 819.181883] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ba096e8-0990-4301-b10d-dee4aea7793e in Status: SUCCESS [ 819.182219] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ba096e8-0990-4301-b10d-dee4aea7793e deletion is rescheduled due to dependency. [ 819.182309] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.255514] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1177107d-489f-423e-bea6-2167ec3c608d with status ACTIVE [ 819.255967] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.256293] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.256504] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.257130] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.257386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.257750] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.258130] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.258389] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.258834] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.259898] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.259898] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.259898] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.259898] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.259898] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.259898] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.261650] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1177107d-489f-423e-bea6-2167ec3c608d is going to be updated. [ 819.286987] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.286987] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.286987] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.287293] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.287293] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.287415] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1177107d-489f-423e-bea6-2167ec3c608d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.289182] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.289309] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.289857] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.290135] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.290256] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.290493] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.290657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.290794] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.291331] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.291331] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.291421] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49148979-263a-4c7a-a007-bfce9aaa037b is going to be updated. [ 819.329180] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.329453] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.329521] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.329906] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.330031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.340402] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49148979-263a-4c7a-a007-bfce9aaa037b in Status: IN_PROGRESS for 2s [ 820.591136] env[70520]: INFO networking_nsxv3.common.synchronization [req-d65e95df-9d02-4b34-b3fd-143b24e683e8 req-64eb5538-4e07-4839-baae-2d2165d662d0 tempest-ServersAdminTestJSON-2063681355 tempest-ServersAdminTestJSON-2063681355-project-member] Enqueued Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_members [ 820.592343] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_members [ 820.592343] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.592343] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.592343] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.592654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.592654] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.592742] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.592742] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.592880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.592975] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.593186] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.961118] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ada31481-82b9-4792-af47-296d5fe27a9f in Status: SUCCESS [ 820.961647] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.961824] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.962596] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.962596] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.962744] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.962825] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.964249] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.966536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.966536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.966536] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada31481-82b9-4792-af47-296d5fe27a9f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.966536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.966536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.966536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.966536] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.966536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.966536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.966536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.966536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.966536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.966536] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ada31481-82b9-4792-af47-296d5fe27a9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.968451] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.968451] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.968451] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.968451] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.968451] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.968451] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.968451] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.968451] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ada31481-82b9-4792-af47-296d5fe27a9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.093724] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-318 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.093923] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-318" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.094056] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-318" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.094410] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-318" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.094855] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.095050] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.095198] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.095413] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.095595] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.097121] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 821.097554] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 821.097689] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 821.097808] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 821.097947] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 821.098078] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 821.098228] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 821.102277] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.102277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.102277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.102277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.102277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.102277] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.102277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.102277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.102277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.102277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.102624] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 already deleted. [ 821.102624] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.119406] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 821.122311] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 821.122311] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 821.122311] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-318" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.122311] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-015554bc-e578-42fa-982b-384496fb4814 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.122311] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-015554bc-e578-42fa-982b-384496fb4814" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.122311] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-015554bc-e578-42fa-982b-384496fb4814" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.122311] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-015554bc-e578-42fa-982b-384496fb4814" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.122311] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('015554bc-e578-42fa-982b-384496fb4814',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.351846] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49148979-263a-4c7a-a007-bfce9aaa037b in Status: SUCCESS [ 821.352077] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49148979-263a-4c7a-a007-bfce9aaa037b deletion is rescheduled due to dependency. [ 821.352244] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.475020] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ada31481-82b9-4792-af47-296d5fe27a9f: rpc.has_security_group_logging(os_id): False [ 821.475020] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ada31481-82b9-4792-af47-296d5fe27a9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.496621] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.496621] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.496621] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.496845] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.496879] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.497493] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.497493] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.497493] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.497493] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.497493] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.497727] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.497768] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.497796] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.497936] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.498151] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.498526] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.498631] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.498689] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.498830] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.498904] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.498987] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ada31481-82b9-4792-af47-296d5fe27a9f is going to be created. [ 821.559327] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.559472] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.559538] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.559760] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.559944] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.571470] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ada31481-82b9-4792-af47-296d5fe27a9f in Status: IN_PROGRESS for 2s [ 821.625964] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.626361] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.626361] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.626858] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.626858] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.627078] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 015554bc-e578-42fa-982b-384496fb4814 not found, creating... [ 821.627262] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.627436] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.627552] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.627803] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.627940] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.628257] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.628420] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.628877] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.628877] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.628877] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.629011] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 015554bc-e578-42fa-982b-384496fb4814 is going to be created. [ 821.695211] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.695379] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.695526] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.695842] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.696091] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.696312] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-015554bc-e578-42fa-982b-384496fb4814" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.980531] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ada31481-82b9-4792-af47-296d5fe27a9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.395538] env[70520]: INFO networking_nsxv3.common.synchronization [req-d65e95df-9d02-4b34-b3fd-143b24e683e8 req-67e604ed-2d6e-4c93-a760-626c6e7fb7c7 service nova] Enqueued Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_rules [ 822.395538] env[70520]: INFO networking_nsxv3.common.synchronization [req-d65e95df-9d02-4b34-b3fd-143b24e683e8 req-67e604ed-2d6e-4c93-a760-626c6e7fb7c7 service nova] Enqueued Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_members [ 822.395538] env[70520]: INFO networking_nsxv3.common.synchronization [req-d65e95df-9d02-4b34-b3fd-143b24e683e8 req-67e604ed-2d6e-4c93-a760-626c6e7fb7c7 service nova] Enqueued Resource ID: 015554bc-e578-42fa-982b-384496fb4814 with Priority: HIGHEST for action port [ 822.395827] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_rules [ 822.396028] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_members [ 822.396174] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 015554bc-e578-42fa-982b-384496fb4814 with Priority: HIGHEST for action port [ 822.397627] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4e36438-996a-4d8f-adfb-5a87b2e7bd82 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.397627] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.397627] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.397627] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.400478] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.400478] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.400478] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.400478] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.400478] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.400478] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.400478] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.400478] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.400478] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.400478] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.400478] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.400967] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-015554bc-e578-42fa-982b-384496fb4814 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.400967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-015554bc-e578-42fa-982b-384496fb4814" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.400967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-015554bc-e578-42fa-982b-384496fb4814" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.403243] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-015554bc-e578-42fa-982b-384496fb4814" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.403389] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('015554bc-e578-42fa-982b-384496fb4814',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.483016] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.483273] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.483408] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.483753] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.483936] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.484144] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ada31481-82b9-4792-af47-296d5fe27a9f is going to be updated. [ 822.542958] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.543173] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.543212] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.543421] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.543650] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.554555] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ada31481-82b9-4792-af47-296d5fe27a9f in Status: IN_PROGRESS for 2s [ 822.905216] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.907525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.907525] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.907525] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 015554bc-e578-42fa-982b-384496fb4814 with status ACTIVE [ 822.907525] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.907525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.907525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.907525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.907525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.907525] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.907525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.907525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.908043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.908043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.908043] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.908288] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.908345] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.911633] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.911633] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.911633] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 015554bc-e578-42fa-982b-384496fb4814 is going to be updated. [ 822.937124] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.937266] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.937266] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.937577] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.937760] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.938492] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-015554bc-e578-42fa-982b-384496fb4814" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.170669] env[70520]: INFO networking_nsxv3.common.synchronization [req-83c3b0ea-63bc-4a8a-a37f-334fe1c075a7 req-03ab13d7-1738-4dcf-a7d9-875c7e7cefa3 tempest-ImagesNegativeTestJSON-1152294652 tempest-ImagesNegativeTestJSON-1152294652-project-member] Enqueued Resource ID: 9e0489ab-02aa-4b50-9561-5dc523b9b99a with Priority: HIGHEST for action security_group_members [ 823.171217] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e0489ab-02aa-4b50-9561-5dc523b9b99a with Priority: HIGHEST for action security_group_members [ 823.171517] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e0489ab-02aa-4b50-9561-5dc523b9b99a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.171638] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.171707] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.171954] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.174617] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.174617] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.177125] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.177354] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.177445] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.177546] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e0489ab-02aa-4b50-9561-5dc523b9b99a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.413070] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.585599] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ada31481-82b9-4792-af47-296d5fe27a9f in Status: SUCCESS [ 823.585599] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.585599] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.586281] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.590152] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ada31481-82b9-4792-af47-296d5fe27a9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.657396] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-335 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.657648] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-335" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.657733] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-335" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.658079] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-335" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.658357] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.658511] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.658628] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.658842] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.658981] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.659212] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 823.659303] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 823.659410] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 823.659518] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 823.659626] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 823.659733] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 823.659862] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 823.682043] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 823.682043] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 823.682043] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 823.682043] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-335" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.682043] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-e3076869-f787-4bb9-8943-443668de518a taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.682043] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-e3076869-f787-4bb9-8943-443668de518a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.682043] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-e3076869-f787-4bb9-8943-443668de518a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.682043] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-e3076869-f787-4bb9-8943-443668de518a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.682043] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3076869-f787-4bb9-8943-443668de518a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.682683] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.682781] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.682781] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.682941] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.683166] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.683228] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.683276] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.683382] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.683669] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.683669] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.683669] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e0489ab-02aa-4b50-9561-5dc523b9b99a already deleted. [ 823.683757] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.913428] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.913774] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.913774] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.913870] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.913932] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.914068] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 is going to be created. [ 823.937457] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.937673] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.937673] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.937895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.938118] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.948164] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: UNINITIALIZED for 2s [ 824.033505] env[70520]: INFO networking_nsxv3.common.synchronization [req-faf17a08-fbbb-4187-9f8f-683516ef863e req-cfe3f17c-0dea-460e-ae9f-c163241c5d37 tempest-ServerMetadataNegativeTestJSON-1722094476 tempest-ServerMetadataNegativeTestJSON-1722094476-project-member] Enqueued Resource ID: 89cb747a-f330-415b-bfd6-17be7d8807fb with Priority: HIGHEST for action security_group_members [ 824.034047] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89cb747a-f330-415b-bfd6-17be7d8807fb with Priority: HIGHEST for action security_group_members [ 824.034423] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-89cb747a-f330-415b-bfd6-17be7d8807fb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.034596] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89cb747a-f330-415b-bfd6-17be7d8807fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.034699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89cb747a-f330-415b-bfd6-17be7d8807fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.034874] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89cb747a-f330-415b-bfd6-17be7d8807fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.035104] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.035239] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.035335] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.035553] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.035686] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.035779] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89cb747a-f330-415b-bfd6-17be7d8807fb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.092869] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada31481-82b9-4792-af47-296d5fe27a9f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.093068] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.186576] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.186842] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.186964] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.187298] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.187446] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.187598] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port e3076869-f787-4bb9-8943-443668de518a not found, creating... [ 824.187861] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.188040] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.188133] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.188342] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.188469] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.188740] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.188889] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.188999] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.189216] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.189344] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.189478] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: e3076869-f787-4bb9-8943-443668de518a is going to be created. [ 824.213432] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.213432] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.213432] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.213432] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.213432] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.213432] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-e3076869-f787-4bb9-8943-443668de518a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.538260] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.538558] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.538558] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.538811] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.538886] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.539248] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.539248] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.539248] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.539631] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.539631] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.539631] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89cb747a-f330-415b-bfd6-17be7d8807fb is going to be updated. [ 824.570159] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ada31481-82b9-4792-af47-296d5fe27a9f in Status: SUCCESS [ 824.570405] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.570594] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.570831] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.571039] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.571173] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.571239] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.571395] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.571474] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.571562] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.571653] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ada31481-82b9-4792-af47-296d5fe27a9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.577559] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.577718] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.577785] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.578083] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.578238] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.589999] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89cb747a-f330-415b-bfd6-17be7d8807fb in Status: IN_PROGRESS for 2s [ 824.986259] env[70520]: INFO networking_nsxv3.common.synchronization [req-83c3b0ea-63bc-4a8a-a37f-334fe1c075a7 req-db26a624-f03a-4f86-ac7a-417453a1b6f2 service nova] Enqueued Resource ID: 9e0489ab-02aa-4b50-9561-5dc523b9b99a with Priority: HIGHEST for action security_group_rules [ 824.986536] env[70520]: INFO networking_nsxv3.common.synchronization [req-83c3b0ea-63bc-4a8a-a37f-334fe1c075a7 req-db26a624-f03a-4f86-ac7a-417453a1b6f2 service nova] Enqueued Resource ID: 9e0489ab-02aa-4b50-9561-5dc523b9b99a with Priority: HIGHEST for action security_group_members [ 824.986572] env[70520]: INFO networking_nsxv3.common.synchronization [req-83c3b0ea-63bc-4a8a-a37f-334fe1c075a7 req-db26a624-f03a-4f86-ac7a-417453a1b6f2 service nova] Enqueued Resource ID: e3076869-f787-4bb9-8943-443668de518a with Priority: HIGHEST for action port [ 824.986874] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e0489ab-02aa-4b50-9561-5dc523b9b99a with Priority: HIGHEST for action security_group_rules [ 824.986939] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e0489ab-02aa-4b50-9561-5dc523b9b99a with Priority: HIGHEST for action security_group_members [ 824.987062] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3076869-f787-4bb9-8943-443668de518a with Priority: HIGHEST for action port [ 824.987978] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e0489ab-02aa-4b50-9561-5dc523b9b99a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.994018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.994018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.994018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.994018] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e0489ab-02aa-4b50-9561-5dc523b9b99a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.994018] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e0489ab-02aa-4b50-9561-5dc523b9b99a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.994018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.994018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.994018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.994018] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.994018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.994018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.994018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.994018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.994018] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e0489ab-02aa-4b50-9561-5dc523b9b99a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.995252] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3076869-f787-4bb9-8943-443668de518a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.995527] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3076869-f787-4bb9-8943-443668de518a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.995717] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3076869-f787-4bb9-8943-443668de518a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.995943] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3076869-f787-4bb9-8943-443668de518a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.996151] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3076869-f787-4bb9-8943-443668de518a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.075843] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada31481-82b9-4792-af47-296d5fe27a9f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.076058] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.076654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.076654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.076654] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.076875] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.076875] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.077462] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.077462] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.077462] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.077462] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada31481-82b9-4792-af47-296d5fe27a9f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.077462] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.077684] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.077684] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.078854] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.078966] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.082536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.082536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.082536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.082536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.082536] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ada31481-82b9-4792-af47-296d5fe27a9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.501138] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e0489ab-02aa-4b50-9561-5dc523b9b99a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.501138] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.501138] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e0489ab-02aa-4b50-9561-5dc523b9b99a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.501138] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e3076869-f787-4bb9-8943-443668de518a with status ACTIVE [ 825.501138] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.501138] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.501138] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.501138] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.501138] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.501138] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.501138] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.501138] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.501138] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.501138] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.501816] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.501816] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.501816] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.501816] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.502718] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.503025] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e3076869-f787-4bb9-8943-443668de518a is going to be updated. [ 825.531551] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.531551] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.531551] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.531551] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.531551] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.531551] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3076869-f787-4bb9-8943-443668de518a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.586597] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ada31481-82b9-4792-af47-296d5fe27a9f: rpc.has_security_group_logging(os_id): False [ 825.616102] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.616253] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.616331] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.616555] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.616654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.616889] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.616996] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.618404] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.618404] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.618404] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.618404] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.618404] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.618404] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.618404] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.618404] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.618732] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.618732] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.618732] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.618940] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.619056] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.620206] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ada31481-82b9-4792-af47-296d5fe27a9f is going to be updated. [ 825.715969] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.716193] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.716193] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.716334] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.716604] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.735397] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ada31481-82b9-4792-af47-296d5fe27a9f in Status: IN_PROGRESS for 2s [ 825.959469] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: SUCCESS [ 825.959592] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.959852] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.960098] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.960293] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.960691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.960691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.960691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.960691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.961177] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.961177] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.008997] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e0489ab-02aa-4b50-9561-5dc523b9b99a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.463824] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.463824] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.463824] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.463824] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.464472] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.467097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.467097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.467097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.467097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.467097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.467097] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.467097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.467097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.467097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.467097] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.467097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.467097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.467097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.467097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.467097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.467097] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.512801] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.512970] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.513053] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.513962] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.513962] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.513962] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e0489ab-02aa-4b50-9561-5dc523b9b99a is going to be created. [ 826.540566] env[70520]: INFO networking_nsxv3.common.synchronization [req-9a386717-58c9-45b4-85f0-5852b495b6dd req-3f9ef5b1-0b18-4d1a-8dcb-cde57fbfd46b tempest-ImagesOneServerNegativeTestJSON-1115954637 tempest-ImagesOneServerNegativeTestJSON-1115954637-project-member] Enqueued Resource ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad with Priority: HIGHEST for action security_group_members [ 826.541809] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.541950] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.542034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.542264] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.542426] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.543846] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad with Priority: HIGHEST for action security_group_members [ 826.544800] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc3c352-f711-4ecc-9064-0883727ce3ad taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.544920] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.544990] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.547672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.547808] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.547918] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.547983] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.548155] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.548238] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.548330] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cc3c352-f711-4ecc-9064-0883727ce3ad',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.561597] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e0489ab-02aa-4b50-9561-5dc523b9b99a in Status: UNINITIALIZED for 2s [ 826.615655] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89cb747a-f330-415b-bfd6-17be7d8807fb in Status: SUCCESS [ 826.615719] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89cb747a-f330-415b-bfd6-17be7d8807fb deletion is rescheduled due to dependency. [ 826.616398] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89cb747a-f330-415b-bfd6-17be7d8807fb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.970264] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4e36438-996a-4d8f-adfb-5a87b2e7bd82: rpc.has_security_group_logging(os_id): False [ 826.992929] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.993140] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.993247] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.993394] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.993638] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.993797] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.993915] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.993998] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.994228] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.994296] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.994490] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.994590] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.994648] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.994800] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.994880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.995435] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.995679] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.995679] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.995868] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.996035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.996097] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 is going to be created. [ 827.052349] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.052349] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.052349] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.052349] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.052972] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.052972] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.052972] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.052972] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.052972] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.053325] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.053325] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad is going to be updated. [ 827.077337] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.077337] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.077337] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.077337] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.077337] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.093238] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: IN_PROGRESS for 2s [ 827.114028] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.114028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.114028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.114028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.114028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.133422] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad in Status: IN_PROGRESS for 2s [ 827.751723] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ada31481-82b9-4792-af47-296d5fe27a9f in Status: SUCCESS [ 827.751999] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.004496] env[70520]: INFO networking_nsxv3.common.synchronization [req-b99f9cd6-6ed0-4ef6-8834-f9dfbd238d93 req-e95ce2ce-3717-42d4-b5a5-42c44792cfd2 tempest-ServersAdminTestJSON-2063681355 tempest-ServersAdminTestJSON-2063681355-project-member] Enqueued Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_members [ 828.004987] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_members [ 828.005350] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.005488] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.005571] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.005814] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.006064] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.006149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.006185] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.006367] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.006451] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.006569] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.380213] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-318 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.380638] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-318" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.380638] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-318" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.380819] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-318" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.381105] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.381212] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.381331] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.381543] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.381686] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.381890] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 828.382032] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 828.382146] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 828.382251] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 828.382359] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 828.382479] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 828.382611] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 828.403286] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 828.403458] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 828.403607] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 828.403789] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-318" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.404109] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-aacd3a4d-090f-4ffc-b23d-d4701a915c12 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.404280] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-aacd3a4d-090f-4ffc-b23d-d4701a915c12" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.404398] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-aacd3a4d-090f-4ffc-b23d-d4701a915c12" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.404729] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-aacd3a4d-090f-4ffc-b23d-d4701a915c12" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.404869] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aacd3a4d-090f-4ffc-b23d-d4701a915c12',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.513406] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.577041] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e0489ab-02aa-4b50-9561-5dc523b9b99a in Status: SUCCESS [ 828.577041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.577041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.577041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.577041] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.577041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.577041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.577041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.577041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.577041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.577041] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e0489ab-02aa-4b50-9561-5dc523b9b99a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.907135] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.907518] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.907746] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.908179] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.908755] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.908755] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port aacd3a4d-090f-4ffc-b23d-d4701a915c12 not found, creating... [ 828.910094] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.910094] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.910094] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.910094] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.910341] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.910627] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.910891] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.911115] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.911474] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.911696] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.911937] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: aacd3a4d-090f-4ffc-b23d-d4701a915c12 is going to be created. [ 828.934458] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.934873] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.934873] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.935853] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.935853] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.936162] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-aacd3a4d-090f-4ffc-b23d-d4701a915c12" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.015986] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.077155] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e0489ab-02aa-4b50-9561-5dc523b9b99a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.077466] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.077466] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.077739] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.077803] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.077942] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.078024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.078188] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.078274] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.078366] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.078597] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e0489ab-02aa-4b50-9561-5dc523b9b99a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.078705] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.078739] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.078869] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.079015] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.079115] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.079182] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.079311] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.079374] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.079455] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.079541] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e0489ab-02aa-4b50-9561-5dc523b9b99a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.108444] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: SUCCESS [ 829.108444] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.144666] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad in Status: SUCCESS [ 829.144666] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad deletion is rescheduled due to dependency. [ 829.144666] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.522435] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.523117] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.523117] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.523648] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.523648] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.523648] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 is going to be updated. [ 829.566030] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.566030] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.566030] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.566030] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.566030] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.576557] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: IN_PROGRESS for 2s [ 829.586681] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e0489ab-02aa-4b50-9561-5dc523b9b99a: rpc.has_security_group_logging(os_id): False [ 829.606433] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.606433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.606433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.606433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.606433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.606433] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.606433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.606433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.606433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.606433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.606433] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.606433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.606433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.606433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.606433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.607014] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.607014] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.607014] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.607014] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.607014] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.607014] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e0489ab-02aa-4b50-9561-5dc523b9b99a is going to be created. [ 829.705767] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.705767] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.705767] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.705767] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.706197] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.723259] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e0489ab-02aa-4b50-9561-5dc523b9b99a in Status: IN_PROGRESS for 2s [ 829.743357] env[70520]: INFO networking_nsxv3.common.synchronization [None req-1059bbb9-dce1-4de8-b039-f25aa4a44a9d None None] Enqueued Resource ID: 1bebb623-b5b9-4e90-afe8-be155bf72220 with Priority: HIGHEST for action port [ 829.745153] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bebb623-b5b9-4e90-afe8-be155bf72220 with Priority: HIGHEST for action port [ 829.745153] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-1bebb623-b5b9-4e90-afe8-be155bf72220 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.745153] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1bebb623-b5b9-4e90-afe8-be155bf72220" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.745410] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1bebb623-b5b9-4e90-afe8-be155bf72220" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.745495] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1bebb623-b5b9-4e90-afe8-be155bf72220" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.745572] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bebb623-b5b9-4e90-afe8-be155bf72220',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.880024] env[70520]: INFO networking_nsxv3.common.synchronization [req-8c2daf57-6e5d-4c30-bdbd-7005f3650105 req-cec3cc51-7fed-4862-8b64-029b05758bb5 tempest-ServersWithSpecificFlavorTestJSON-1288943951 tempest-ServersWithSpecificFlavorTestJSON-1288943951-project-member] Enqueued Resource ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee with Priority: HIGHEST for action security_group_members [ 829.880571] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee with Priority: HIGHEST for action security_group_members [ 829.881201] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-2449c3c4-f89c-449c-97e2-c22d5d72dbee taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.881341] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.881341] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.882297] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.882297] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.882297] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.882297] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.882297] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.882297] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.883580] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2449c3c4-f89c-449c-97e2-c22d5d72dbee',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.077875] env[70520]: INFO networking_nsxv3.common.synchronization [req-b99f9cd6-6ed0-4ef6-8834-f9dfbd238d93 req-8b85bab9-4ddf-41a9-a877-0fd07b3baf76 service nova] Enqueued Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_rules [ 830.077875] env[70520]: INFO networking_nsxv3.common.synchronization [req-b99f9cd6-6ed0-4ef6-8834-f9dfbd238d93 req-8b85bab9-4ddf-41a9-a877-0fd07b3baf76 service nova] Enqueued Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_members [ 830.078209] env[70520]: INFO networking_nsxv3.common.synchronization [req-b99f9cd6-6ed0-4ef6-8834-f9dfbd238d93 req-8b85bab9-4ddf-41a9-a877-0fd07b3baf76 service nova] Enqueued Resource ID: aacd3a4d-090f-4ffc-b23d-d4701a915c12 with Priority: HIGHEST for action port [ 830.079838] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_rules [ 830.079838] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_members [ 830.079838] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aacd3a4d-090f-4ffc-b23d-d4701a915c12 with Priority: HIGHEST for action port [ 830.079838] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4e36438-996a-4d8f-adfb-5a87b2e7bd82 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.079838] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.079838] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.079838] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.079838] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.080817] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.080817] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.080817] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-aacd3a4d-090f-4ffc-b23d-d4701a915c12 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.080989] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aacd3a4d-090f-4ffc-b23d-d4701a915c12" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.080989] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aacd3a4d-090f-4ffc-b23d-d4701a915c12" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.081659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aacd3a4d-090f-4ffc-b23d-d4701a915c12" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.081659] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aacd3a4d-090f-4ffc-b23d-d4701a915c12',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.249028] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1bebb623-b5b9-4e90-afe8-be155bf72220 [ 830.249028] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.249028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.249028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.249028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.249028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.249028] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1bebb623-b5b9-4e90-afe8-be155bf72220 already deleted. [ 830.249028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1bebb623-b5b9-4e90-afe8-be155bf72220" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.389197] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.389801] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.389801] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.389801] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.389801] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.389992] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.390101] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.390145] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.390282] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.390354] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.390433] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee is going to be updated. [ 830.426843] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.426843] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.426843] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.426843] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.426843] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.436342] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee in Status: IN_PROGRESS for 2s [ 830.587883] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.588174] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.588292] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aacd3a4d-090f-4ffc-b23d-d4701a915c12 with status ACTIVE [ 830.588446] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.588563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.588627] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.588844] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.588927] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.589157] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.589272] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.589324] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.591032] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.591032] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.591032] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.591032] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.591032] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.591032] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.591032] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.591032] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aacd3a4d-090f-4ffc-b23d-d4701a915c12 is going to be updated. [ 830.631626] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.635031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.635031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.635031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.635031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.635031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aacd3a4d-090f-4ffc-b23d-d4701a915c12" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.425347] env[70520]: INFO networking_nsxv3.common.synchronization [None req-83244a84-755d-4859-a740-c08f9255ab70 tempest-ServerActionsTestJSON-420425725 tempest-ServerActionsTestJSON-420425725-project-member] Enqueued Resource ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c with Priority: HIGHEST for action security_group_rules [ 831.425874] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c with Priority: HIGHEST for action security_group_rules [ 831.425874] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d999f7b-50c9-40ee-b3b1-31ead407224c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.425874] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.425979] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.429782] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.429782] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d999f7b-50c9-40ee-b3b1-31ead407224c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.564854] env[70520]: INFO networking_nsxv3.common.synchronization [None req-a8a77abf-f1ca-4a1b-89e0-71de5541c385 tempest-ServerActionsTestJSON-420425725 tempest-ServerActionsTestJSON-420425725-project-member] Enqueued Resource ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c with Priority: HIGHEST for action security_group_rules [ 831.565659] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c with Priority: HIGHEST for action security_group_rules [ 831.565838] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d999f7b-50c9-40ee-b3b1-31ead407224c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.565966] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.592654] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: SUCCESS [ 831.592654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.592654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.592654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.592654] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.592654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.592654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.592654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.592654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.592654] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.741761] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e0489ab-02aa-4b50-9561-5dc523b9b99a in Status: SUCCESS [ 831.742068] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.950860] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.951071] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.951191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.951442] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.951547] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.951653] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c already deleted. [ 831.951778] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.951945] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.952150] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.952246] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d999f7b-50c9-40ee-b3b1-31ead407224c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.096544] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.107505] env[70520]: INFO networking_nsxv3.common.synchronization [None req-2accb120-5b40-4919-a496-f54e6f2177e7 None None] Enqueued Resource ID: 565a129e-e8c9-4f2f-9549-e7162a2afcf8 with Priority: HIGHEST for action port [ 832.107505] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 565a129e-e8c9-4f2f-9549-e7162a2afcf8 with Priority: HIGHEST for action port [ 832.110582] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-565a129e-e8c9-4f2f-9549-e7162a2afcf8 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.110830] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-565a129e-e8c9-4f2f-9549-e7162a2afcf8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.110950] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-565a129e-e8c9-4f2f-9549-e7162a2afcf8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.111181] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-565a129e-e8c9-4f2f-9549-e7162a2afcf8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.111268] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('565a129e-e8c9-4f2f-9549-e7162a2afcf8',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.447122] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee in Status: SUCCESS [ 832.447363] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee deletion is rescheduled due to dependency. [ 832.447529] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.475174] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.475368] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.475368] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.475600] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.475733] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.475845] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c already deleted. [ 832.475943] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.598381] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.619404] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 565a129e-e8c9-4f2f-9549-e7162a2afcf8 [ 832.619759] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.619916] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.619983] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.620230] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.620345] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.620483] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:565a129e-e8c9-4f2f-9549-e7162a2afcf8 already deleted. [ 832.620602] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-565a129e-e8c9-4f2f-9549-e7162a2afcf8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.100322] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.100437] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.100552] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.100703] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.100816] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.100884] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 is going to be updated. [ 833.136715] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.136965] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.136965] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.137167] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.137582] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.151106] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: IN_PROGRESS for 2s [ 835.163487] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: SUCCESS [ 835.164341] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.164581] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.164819] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.165059] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.165213] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.165291] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.165484] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.165652] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.165718] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.165778] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.534175] env[70520]: INFO networking_nsxv3.common.synchronization [req-035304f0-b06e-462d-8ef8-b0885fc325b1 req-69eda1e0-42e1-48ff-bcf3-c4defc194f39 tempest-ImagesNegativeTestJSON-1152294652 tempest-ImagesNegativeTestJSON-1152294652-project-member] Enqueued Resource ID: 9e0489ab-02aa-4b50-9561-5dc523b9b99a with Priority: HIGHEST for action security_group_members [ 835.534721] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e0489ab-02aa-4b50-9561-5dc523b9b99a with Priority: HIGHEST for action security_group_members [ 835.535026] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e0489ab-02aa-4b50-9561-5dc523b9b99a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.535141] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.535224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.535435] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.535668] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.539614] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.539779] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.539931] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.540053] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.540327] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e0489ab-02aa-4b50-9561-5dc523b9b99a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.668295] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.668537] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.668537] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.668848] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.668913] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.669024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.669079] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.669231] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.669316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.669402] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.669552] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.669672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.669672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.669809] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.669941] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.670042] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.670098] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.670232] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.670306] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.670386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.670473] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.047218] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.047218] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.047413] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.047499] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.047640] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.047863] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.048044] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.048044] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.048261] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.048364] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.048473] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e0489ab-02aa-4b50-9561-5dc523b9b99a is going to be updated. [ 836.085980] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.086221] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.086266] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.086514] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.086714] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.098281] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e0489ab-02aa-4b50-9561-5dc523b9b99a in Status: IN_PROGRESS for 2s [ 836.173500] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4e36438-996a-4d8f-adfb-5a87b2e7bd82: rpc.has_security_group_logging(os_id): False [ 836.204465] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.204614] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.204652] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.204941] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.205078] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.205306] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.205436] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.205536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.206105] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.206105] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.206105] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.206283] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.206283] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.206392] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.206465] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.206737] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.206841] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.206928] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.207045] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.207123] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.207237] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 is going to be updated. [ 836.283051] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.283282] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.283520] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.283713] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.283924] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.303498] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: IN_PROGRESS for 2s [ 838.110236] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e0489ab-02aa-4b50-9561-5dc523b9b99a in Status: SUCCESS [ 838.110546] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e0489ab-02aa-4b50-9561-5dc523b9b99a deletion is rescheduled due to dependency. [ 838.111114] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.318703] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: SUCCESS [ 838.318917] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.536215] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 840.536902] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 840.989553] env[70520]: INFO networking_nsxv3.common.synchronization [req-558c5534-5163-4cd1-b812-62adf6fce762 req-b0af3fd4-62d8-41ce-969c-04ef9a332c9b tempest-ServerRescueTestJSONUnderV235-1054354334 tempest-ServerRescueTestJSONUnderV235-1054354334-project-member] Enqueued Resource ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 with Priority: HIGHEST for action security_group_members [ 840.990138] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 with Priority: HIGHEST for action security_group_members [ 840.990896] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.990896] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.990896] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.990896] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.991478] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.992017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.992017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.992017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.992248] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.992248] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92a0a3db-a366-45d6-b0b8-a9a2b4be13d4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.483974] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-758 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.484149] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-758" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.484270] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-758" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.484656] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-758" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.486761] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.486939] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.487077] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.487369] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.487485] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.487722] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 841.487853] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 841.487948] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 841.488098] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 841.488217] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 841.488328] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 841.488463] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 841.494908] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.495178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.495178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.495539] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.495539] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.495836] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.495836] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.495836] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.496045] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.496045] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.496317] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 already deleted. [ 841.496317] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.509090] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 841.509274] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 841.509412] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 841.509622] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-758" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.510067] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-1f1a0487-973c-4614-ae20-da574807de9c taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.510196] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-1f1a0487-973c-4614-ae20-da574807de9c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.510419] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-1f1a0487-973c-4614-ae20-da574807de9c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.510629] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-1f1a0487-973c-4614-ae20-da574807de9c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.510768] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f1a0487-973c-4614-ae20-da574807de9c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.013633] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.017522] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.017522] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.017522] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.017522] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.017522] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 1f1a0487-973c-4614-ae20-da574807de9c not found, creating... [ 842.017522] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.017522] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.017522] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.017522] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.017522] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.018166] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.018166] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.018166] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.018624] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.018908] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.019931] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 1f1a0487-973c-4614-ae20-da574807de9c is going to be created. [ 842.042046] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.042271] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.042429] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.042668] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.043709] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.043709] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-1f1a0487-973c-4614-ae20-da574807de9c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.109545] env[70520]: INFO networking_nsxv3.common.synchronization [req-558c5534-5163-4cd1-b812-62adf6fce762 req-ffeffaa4-da67-46b7-ab98-4773a9099b53 service nova] Enqueued Resource ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 with Priority: HIGHEST for action security_group_rules [ 843.109814] env[70520]: INFO networking_nsxv3.common.synchronization [req-558c5534-5163-4cd1-b812-62adf6fce762 req-ffeffaa4-da67-46b7-ab98-4773a9099b53 service nova] Enqueued Resource ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 with Priority: HIGHEST for action security_group_members [ 843.109860] env[70520]: INFO networking_nsxv3.common.synchronization [req-558c5534-5163-4cd1-b812-62adf6fce762 req-ffeffaa4-da67-46b7-ab98-4773a9099b53 service nova] Enqueued Resource ID: 1f1a0487-973c-4614-ae20-da574807de9c with Priority: HIGHEST for action port [ 843.110699] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 with Priority: HIGHEST for action security_group_rules [ 843.110847] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 with Priority: HIGHEST for action security_group_members [ 843.110946] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f1a0487-973c-4614-ae20-da574807de9c with Priority: HIGHEST for action port [ 843.111275] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.111447] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.111539] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.111795] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.111901] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92a0a3db-a366-45d6-b0b8-a9a2b4be13d4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.113410] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.113521] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.113521] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.113845] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.114101] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.114205] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.114270] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.114467] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.114575] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.114802] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92a0a3db-a366-45d6-b0b8-a9a2b4be13d4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.115918] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f1a0487-973c-4614-ae20-da574807de9c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.115918] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f1a0487-973c-4614-ae20-da574807de9c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.116092] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f1a0487-973c-4614-ae20-da574807de9c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.116131] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f1a0487-973c-4614-ae20-da574807de9c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.119582] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f1a0487-973c-4614-ae20-da574807de9c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.268167] env[70520]: INFO networking_nsxv3.common.synchronization [None req-f8353cde-a41a-495c-a50e-a825029c7059 None None] Enqueued Resource ID: c3cd2b10-1706-43dc-99cf-5ed0b9a99fbc with Priority: HIGHEST for action port [ 843.268884] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3cd2b10-1706-43dc-99cf-5ed0b9a99fbc with Priority: HIGHEST for action port [ 843.269508] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3cd2b10-1706-43dc-99cf-5ed0b9a99fbc taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.269701] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3cd2b10-1706-43dc-99cf-5ed0b9a99fbc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.269789] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3cd2b10-1706-43dc-99cf-5ed0b9a99fbc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.270097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3cd2b10-1706-43dc-99cf-5ed0b9a99fbc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.270285] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3cd2b10-1706-43dc-99cf-5ed0b9a99fbc',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.617772] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92a0a3db-a366-45d6-b0b8-a9a2b4be13d4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.621925] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.621925] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.621925] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f1a0487-973c-4614-ae20-da574807de9c with status ACTIVE [ 843.623311] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.623499] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.623616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.624118] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.624225] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.624419] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.625851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.625851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.625851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.625851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.625851] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.625851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.626175] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.626493] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.626890] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.627031] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f1a0487-973c-4614-ae20-da574807de9c is going to be updated. [ 843.653853] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.653853] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.653853] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.653853] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.653853] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.654251] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f1a0487-973c-4614-ae20-da574807de9c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.774970] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c3cd2b10-1706-43dc-99cf-5ed0b9a99fbc [ 843.774970] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.774970] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.774970] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.774970] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.774970] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.775259] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c3cd2b10-1706-43dc-99cf-5ed0b9a99fbc already deleted. [ 843.775259] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3cd2b10-1706-43dc-99cf-5ed0b9a99fbc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.121617] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92a0a3db-a366-45d6-b0b8-a9a2b4be13d4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.624517] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.624694] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.624776] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.625321] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.625578] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.625578] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 is going to be created. [ 844.658043] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.661019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.661019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.661019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.661019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.674237] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 in Status: UNINITIALIZED for 2s [ 844.931140] env[70520]: INFO networking_nsxv3.common.synchronization [req-d0cb7640-552e-447d-aa2a-7d002389f7a0 req-93c14438-a6f2-487f-9c34-78b3811e63c9 tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_members [ 844.932351] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_members [ 844.932709] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.934397] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.934397] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.934397] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.934397] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.934397] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.934397] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.934397] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.934397] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.934397] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.441074] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.441074] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.441074] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.441074] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.441074] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.441074] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.441074] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.441074] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.441074] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.441074] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.441074] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 already deleted. [ 845.441074] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.541330] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.541330] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-653" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.541330] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-653" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.541330] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-653" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.541330] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.541330] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.541330] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.541330] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.541330] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.542790] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 845.542842] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 845.542969] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 845.543124] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 845.543249] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 845.544679] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 845.544679] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 845.571138] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 845.571357] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 845.571571] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 845.571820] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-653" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.572189] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-974f8b65-96da-40a8-96a1-22a5d944e0dd taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.572385] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-974f8b65-96da-40a8-96a1-22a5d944e0dd" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.572487] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-974f8b65-96da-40a8-96a1-22a5d944e0dd" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.572833] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-974f8b65-96da-40a8-96a1-22a5d944e0dd" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.572977] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('974f8b65-96da-40a8-96a1-22a5d944e0dd',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.712525] env[70520]: INFO networking_nsxv3.common.synchronization [None req-4e870398-d48b-4af2-89e9-7742fabeeffb None None] Enqueued Resource ID: 9b74a492-513c-4bce-9a92-367f10b2fc5b with Priority: HIGHEST for action port [ 845.713688] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b74a492-513c-4bce-9a92-367f10b2fc5b with Priority: HIGHEST for action port [ 845.713688] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b74a492-513c-4bce-9a92-367f10b2fc5b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.713688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b74a492-513c-4bce-9a92-367f10b2fc5b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.713688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b74a492-513c-4bce-9a92-367f10b2fc5b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.714048] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b74a492-513c-4bce-9a92-367f10b2fc5b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.714048] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b74a492-513c-4bce-9a92-367f10b2fc5b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.076943] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.077320] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.077488] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.077790] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.077979] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.078235] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 974f8b65-96da-40a8-96a1-22a5d944e0dd not found, creating... [ 846.078533] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.078727] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.078885] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.079146] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.079321] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.079629] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.079837] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.079995] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.080288] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.080467] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.080633] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 974f8b65-96da-40a8-96a1-22a5d944e0dd is going to be created. [ 846.112519] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.112824] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.112962] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.113268] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.113569] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.113789] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-974f8b65-96da-40a8-96a1-22a5d944e0dd" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.216628] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b74a492-513c-4bce-9a92-367f10b2fc5b [ 846.217064] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.217231] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.217303] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.217840] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.217840] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.217840] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b74a492-513c-4bce-9a92-367f10b2fc5b already deleted. [ 846.217840] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b74a492-513c-4bce-9a92-367f10b2fc5b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.685694] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 in Status: SUCCESS [ 846.686150] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.687218] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.687218] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.687218] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.687218] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.687218] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.687218] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.687218] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.687218] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.687218] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('92a0a3db-a366-45d6-b0b8-a9a2b4be13d4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.196442] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.197662] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.197662] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.197662] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.197905] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.201208] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.201288] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.202015] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.202015] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.202015] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.202015] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.202015] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.202015] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.202291] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.202291] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.202403] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.202468] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.202561] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.202656] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.202702] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.203087] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('92a0a3db-a366-45d6-b0b8-a9a2b4be13d4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.257546] env[70520]: INFO networking_nsxv3.common.synchronization [req-d0cb7640-552e-447d-aa2a-7d002389f7a0 req-ad83db10-c8eb-44cc-8f53-196a2f079158 service nova] Enqueued Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_rules [ 847.257723] env[70520]: INFO networking_nsxv3.common.synchronization [req-d0cb7640-552e-447d-aa2a-7d002389f7a0 req-ad83db10-c8eb-44cc-8f53-196a2f079158 service nova] Enqueued Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_members [ 847.257862] env[70520]: INFO networking_nsxv3.common.synchronization [req-d0cb7640-552e-447d-aa2a-7d002389f7a0 req-ad83db10-c8eb-44cc-8f53-196a2f079158 service nova] Enqueued Resource ID: 974f8b65-96da-40a8-96a1-22a5d944e0dd with Priority: HIGHEST for action port [ 847.258188] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_rules [ 847.258319] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_members [ 847.258414] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 974f8b65-96da-40a8-96a1-22a5d944e0dd with Priority: HIGHEST for action port [ 847.258967] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.263185] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.263320] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.263534] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.263639] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.264563] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.264676] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.264745] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.264919] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.265305] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.265305] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.265305] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.265452] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.265452] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.265539] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.266330] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-974f8b65-96da-40a8-96a1-22a5d944e0dd taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.266440] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-974f8b65-96da-40a8-96a1-22a5d944e0dd" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.266555] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-974f8b65-96da-40a8-96a1-22a5d944e0dd" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.266810] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-974f8b65-96da-40a8-96a1-22a5d944e0dd" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.266810] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('974f8b65-96da-40a8-96a1-22a5d944e0dd',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.686558] env[70520]: INFO networking_nsxv3.common.synchronization [req-32893ae4-bbdb-44f9-a51c-f2edd720ad6e req-9b1b601e-d420-47b2-a7ff-856dc41c4aaa tempest-FloatingIPsAssociationNegativeTestJSON-1182819157 tempest-FloatingIPsAssociationNegativeTestJSON-1182819157-project-member] Enqueued Resource ID: e541827f-5a38-4732-ac7b-f8cf25dc1ec1 with Priority: HIGHEST for action security_group_members [ 847.687171] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e541827f-5a38-4732-ac7b-f8cf25dc1ec1 with Priority: HIGHEST for action security_group_members [ 847.687486] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.687607] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.688436] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.688436] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.688436] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.688436] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.688436] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.688436] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.688733] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.688733] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e541827f-5a38-4732-ac7b-f8cf25dc1ec1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.704897] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4: rpc.has_security_group_logging(os_id): False [ 847.726356] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.726657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.728674] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.729009] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.729123] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.729355] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.729473] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.729538] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.729706] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.729796] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.730084] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.730197] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.730249] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.730385] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.730458] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.730642] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.730730] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.730788] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.730918] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.730990] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.732117] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 is going to be created. [ 847.770371] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.771092] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.771092] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.773119] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 974f8b65-96da-40a8-96a1-22a5d944e0dd with status ACTIVE [ 847.773119] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.773119] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.773119] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.773119] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.773119] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.773119] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.773119] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.773119] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.773119] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.773643] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.773756] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.773917] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.774022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.774186] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.774262] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.774350] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 974f8b65-96da-40a8-96a1-22a5d944e0dd is going to be updated. [ 847.799773] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.799958] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.800154] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.800224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.800339] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.800602] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-974f8b65-96da-40a8-96a1-22a5d944e0dd" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.807302] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.807302] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.807302] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.807302] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.807302] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.821398] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 in Status: IN_PROGRESS for 2s [ 848.195965] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.196140] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.196207] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.196442] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.196541] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.196772] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.196892] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.196951] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.197132] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.197205] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.197292] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e541827f-5a38-4732-ac7b-f8cf25dc1ec1 already deleted. [ 848.197382] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.223695] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-734 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.223939] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-734" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.224120] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-734" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.225032] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-734" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.225032] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.225032] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.226473] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.226473] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.226580] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.226761] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 848.226889] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 848.227037] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 848.227156] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 848.227350] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 848.227403] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 848.227494] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 848.261932] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 848.262160] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 848.262307] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 848.262519] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-734" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.262977] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-b96b3754-70de-4a1d-bc3c-2e1b2e15de36 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.263202] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-b96b3754-70de-4a1d-bc3c-2e1b2e15de36" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.263355] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-b96b3754-70de-4a1d-bc3c-2e1b2e15de36" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.263738] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-b96b3754-70de-4a1d-bc3c-2e1b2e15de36" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.263920] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b96b3754-70de-4a1d-bc3c-2e1b2e15de36',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.277640] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.766891] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.767245] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.767245] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.767527] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.767667] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.767819] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port b96b3754-70de-4a1d-bc3c-2e1b2e15de36 not found, creating... [ 848.768716] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.769045] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.769207] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.769843] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.770145] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.770350] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.770628] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.770778] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.771076] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.771234] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.771359] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: b96b3754-70de-4a1d-bc3c-2e1b2e15de36 is going to be created. [ 848.783738] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.783901] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.784513] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.784513] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.784513] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.784513] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 is going to be created. [ 848.795015] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.795015] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.795137] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.795619] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.795619] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.795984] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-b96b3754-70de-4a1d-bc3c-2e1b2e15de36" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.815561] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.815709] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.815959] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.820299] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.820299] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.828002] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: UNINITIALIZED for 2s [ 849.839784] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 in Status: SUCCESS [ 849.840140] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.862707] env[70520]: INFO networking_nsxv3.common.synchronization [req-32893ae4-bbdb-44f9-a51c-f2edd720ad6e req-192038a1-af72-43b4-ae00-777da3044c9c service nova] Enqueued Resource ID: e541827f-5a38-4732-ac7b-f8cf25dc1ec1 with Priority: HIGHEST for action security_group_rules [ 849.862861] env[70520]: INFO networking_nsxv3.common.synchronization [req-32893ae4-bbdb-44f9-a51c-f2edd720ad6e req-192038a1-af72-43b4-ae00-777da3044c9c service nova] Enqueued Resource ID: e541827f-5a38-4732-ac7b-f8cf25dc1ec1 with Priority: HIGHEST for action security_group_members [ 849.863391] env[70520]: INFO networking_nsxv3.common.synchronization [req-32893ae4-bbdb-44f9-a51c-f2edd720ad6e req-192038a1-af72-43b4-ae00-777da3044c9c service nova] Enqueued Resource ID: b96b3754-70de-4a1d-bc3c-2e1b2e15de36 with Priority: HIGHEST for action port [ 849.866926] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e541827f-5a38-4732-ac7b-f8cf25dc1ec1 with Priority: HIGHEST for action security_group_rules [ 849.867169] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e541827f-5a38-4732-ac7b-f8cf25dc1ec1 with Priority: HIGHEST for action security_group_members [ 849.867358] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b96b3754-70de-4a1d-bc3c-2e1b2e15de36 with Priority: HIGHEST for action port [ 849.867769] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e541827f-5a38-4732-ac7b-f8cf25dc1ec1 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.867972] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.868115] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.868491] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.868627] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e541827f-5a38-4732-ac7b-f8cf25dc1ec1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.872095] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.872225] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.872293] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.872488] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.872768] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.873080] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.873166] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.873406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.873545] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.873650] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e541827f-5a38-4732-ac7b-f8cf25dc1ec1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.874850] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-b96b3754-70de-4a1d-bc3c-2e1b2e15de36 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.875756] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b96b3754-70de-4a1d-bc3c-2e1b2e15de36" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.875865] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b96b3754-70de-4a1d-bc3c-2e1b2e15de36" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.876128] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b96b3754-70de-4a1d-bc3c-2e1b2e15de36" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.876248] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b96b3754-70de-4a1d-bc3c-2e1b2e15de36',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.378862] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e541827f-5a38-4732-ac7b-f8cf25dc1ec1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.384893] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.384893] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.384893] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b96b3754-70de-4a1d-bc3c-2e1b2e15de36 with status ACTIVE [ 850.384893] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.384893] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.384893] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.384893] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.384893] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.384893] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.384893] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.384893] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.384893] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.384893] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.384893] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.385862] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.385862] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.385862] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.385862] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.385862] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b96b3754-70de-4a1d-bc3c-2e1b2e15de36 is going to be updated. [ 850.411123] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.411332] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.411406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.411623] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.411764] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.411933] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b96b3754-70de-4a1d-bc3c-2e1b2e15de36" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.842661] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: SUCCESS [ 850.843466] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.843466] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.843466] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.843622] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.843728] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.843773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.843907] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.843982] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.844078] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.844185] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.882978] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e541827f-5a38-4732-ac7b-f8cf25dc1ec1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.104169] env[70520]: INFO networking_nsxv3.common.synchronization [req-ca9c9c24-b43c-4bef-8924-fd26dd42e877 req-ea81e543-93c2-4ddd-89d0-b2a079a26bfa tempest-DeleteServersTestJSON-1399047283 tempest-DeleteServersTestJSON-1399047283-project-member] Enqueued Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 851.104169] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 851.104169] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.104169] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.104169] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.105296] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.105472] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.105683] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.105683] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.106228] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.106228] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.106228] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.348268] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.348268] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.348268] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.348268] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.348268] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.348268] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.348268] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.348268] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.348268] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.348268] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.348268] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.348268] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.348268] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.348268] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.348268] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.348268] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.350405] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.350405] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.350405] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.350405] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.350405] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.387580] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.387876] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.387876] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.388232] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.388344] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.388462] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e541827f-5a38-4732-ac7b-f8cf25dc1ec1 is going to be created. [ 851.431763] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.431763] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.431763] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.431763] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.431763] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.441521] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e541827f-5a38-4732-ac7b-f8cf25dc1ec1 in Status: UNINITIALIZED for 2s [ 851.609127] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.609347] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.609417] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.609644] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.609740] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.609947] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.610053] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.610182] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.610354] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.610429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.610519] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f is going to be updated. [ 851.612158] env[70520]: INFO networking_nsxv3.common.synchronization [None req-00024b44-78c9-430f-ae4c-ef7cb9dd8e9e None None] Enqueued Resource ID: ad252849-e45c-4487-bdf7-046cf8c39d05 with Priority: HIGHEST for action port [ 851.612817] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad252849-e45c-4487-bdf7-046cf8c39d05 with Priority: HIGHEST for action port [ 851.613601] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad252849-e45c-4487-bdf7-046cf8c39d05 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.613717] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad252849-e45c-4487-bdf7-046cf8c39d05" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.613829] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad252849-e45c-4487-bdf7-046cf8c39d05" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.614774] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad252849-e45c-4487-bdf7-046cf8c39d05" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.614774] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad252849-e45c-4487-bdf7-046cf8c39d05',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.652751] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.652901] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.653112] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.653196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.653343] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.664052] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: IN_PROGRESS for 2s [ 851.854264] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b22ab11-3a43-4e3c-a9ac-8ee49b487341: rpc.has_security_group_logging(os_id): False [ 851.877407] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.877603] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.877676] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.877893] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.877995] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.878235] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.878340] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.878391] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.878561] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.878637] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.878814] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.878900] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.878962] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.879126] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.879223] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.879461] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.879584] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.879665] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.879789] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.879858] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.879941] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 is going to be created. [ 851.925327] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-493 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.925543] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-493" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.925664] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-493" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.926025] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-493" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.927149] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.927389] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.927519] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.927830] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.928013] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.928269] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 851.928426] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 851.928684] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 851.929331] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 851.929526] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 851.929700] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 851.929940] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 851.953019] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 851.953019] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 851.953019] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 851.953019] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-493" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.953019] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-3d5a0052-c08a-45b1-aaf1-c99d18618367 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.953019] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-3d5a0052-c08a-45b1-aaf1-c99d18618367" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.953019] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-3d5a0052-c08a-45b1-aaf1-c99d18618367" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.953019] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-3d5a0052-c08a-45b1-aaf1-c99d18618367" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.953019] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d5a0052-c08a-45b1-aaf1-c99d18618367',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.957067] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.957216] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.957290] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.957501] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.957692] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.982128] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: IN_PROGRESS for 2s [ 852.117319] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad252849-e45c-4487-bdf7-046cf8c39d05 [ 852.117644] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.117827] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.117910] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.118234] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.118374] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.118498] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad252849-e45c-4487-bdf7-046cf8c39d05 already deleted. [ 852.118587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad252849-e45c-4487-bdf7-046cf8c39d05" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.455104] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.455381] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.455521] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.456360] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.456360] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.456360] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 3d5a0052-c08a-45b1-aaf1-c99d18618367 not found, creating... [ 852.456932] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.457238] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.457722] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.457722] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.457866] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.461264] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.461264] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.461264] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.461264] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.461264] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.461264] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 3d5a0052-c08a-45b1-aaf1-c99d18618367 is going to be created. [ 852.493020] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.493020] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.493020] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.493020] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.493020] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.493020] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-3d5a0052-c08a-45b1-aaf1-c99d18618367" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.193830] env[70520]: INFO networking_nsxv3.common.synchronization [None req-42b0b3fa-0346-4de8-ba52-7b4c09c66a14 None None] Enqueued Resource ID: 8f2ab100-c2a3-413b-b21b-5ca03468792e with Priority: HIGHEST for action port [ 853.194112] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f2ab100-c2a3-413b-b21b-5ca03468792e with Priority: HIGHEST for action port [ 853.195529] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f2ab100-c2a3-413b-b21b-5ca03468792e taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.195529] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f2ab100-c2a3-413b-b21b-5ca03468792e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.195529] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f2ab100-c2a3-413b-b21b-5ca03468792e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.195529] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f2ab100-c2a3-413b-b21b-5ca03468792e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.195529] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f2ab100-c2a3-413b-b21b-5ca03468792e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.454418] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e541827f-5a38-4732-ac7b-f8cf25dc1ec1 in Status: SUCCESS [ 853.454653] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.455269] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.455506] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.455705] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.455967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.455967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.456112] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.456192] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.456277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.457060] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e541827f-5a38-4732-ac7b-f8cf25dc1ec1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.655363] env[70520]: INFO networking_nsxv3.common.synchronization [req-ca9c9c24-b43c-4bef-8924-fd26dd42e877 req-794f1d2f-4b0b-4a12-8882-7f33ba58f2f0 service nova] Enqueued Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_rules [ 853.655363] env[70520]: INFO networking_nsxv3.common.synchronization [req-ca9c9c24-b43c-4bef-8924-fd26dd42e877 req-794f1d2f-4b0b-4a12-8882-7f33ba58f2f0 service nova] Enqueued Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 853.655363] env[70520]: INFO networking_nsxv3.common.synchronization [req-ca9c9c24-b43c-4bef-8924-fd26dd42e877 req-794f1d2f-4b0b-4a12-8882-7f33ba58f2f0 service nova] Enqueued Resource ID: 3d5a0052-c08a-45b1-aaf1-c99d18618367 with Priority: HIGHEST for action port [ 853.656439] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_rules [ 853.656924] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 853.657158] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d5a0052-c08a-45b1-aaf1-c99d18618367 with Priority: HIGHEST for action port [ 853.657784] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.659260] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.659260] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.659260] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.659260] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.659573] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.659677] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.659892] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d5a0052-c08a-45b1-aaf1-c99d18618367 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.659998] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d5a0052-c08a-45b1-aaf1-c99d18618367" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.660354] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d5a0052-c08a-45b1-aaf1-c99d18618367" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.660570] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d5a0052-c08a-45b1-aaf1-c99d18618367" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.660644] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d5a0052-c08a-45b1-aaf1-c99d18618367',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.676014] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: SUCCESS [ 853.676014] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f deletion is rescheduled due to dependency. [ 853.676186] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.676659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.676935] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.677304] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.677304] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.677507] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.678427] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.678568] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.678843] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.698245] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f2ab100-c2a3-413b-b21b-5ca03468792e [ 853.699244] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.699244] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.699244] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.699382] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.699414] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.699553] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f2ab100-c2a3-413b-b21b-5ca03468792e already deleted. [ 853.699882] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f2ab100-c2a3-413b-b21b-5ca03468792e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.799557] env[70520]: INFO networking_nsxv3.common.synchronization [None req-fd738b11-62c5-4c69-8d33-b317f6cf98fa None None] Enqueued Resource ID: b19db982-c704-4d3a-afb3-6084489072b4 with Priority: HIGHEST for action port [ 853.800303] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b19db982-c704-4d3a-afb3-6084489072b4 with Priority: HIGHEST for action port [ 853.800718] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-b19db982-c704-4d3a-afb3-6084489072b4 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.800855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b19db982-c704-4d3a-afb3-6084489072b4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.800936] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b19db982-c704-4d3a-afb3-6084489072b4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.801208] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b19db982-c704-4d3a-afb3-6084489072b4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.801293] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b19db982-c704-4d3a-afb3-6084489072b4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.961585] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.961760] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.961868] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.962155] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.962321] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.962424] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.962517] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.962684] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.962775] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.962862] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.963035] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.963178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.963242] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.963461] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.963516] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.963604] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.963659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.963853] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.963931] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.964019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.964105] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e541827f-5a38-4732-ac7b-f8cf25dc1ec1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.995415] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: SUCCESS [ 853.995700] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.162508] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.162702] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.162959] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3d5a0052-c08a-45b1-aaf1-c99d18618367 with status ACTIVE [ 854.163062] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.163169] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.163230] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.163439] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.163525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.163755] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.163851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.163961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.164090] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.164180] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.164337] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.164429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.164489] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.164626] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.164808] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.164808] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3d5a0052-c08a-45b1-aaf1-c99d18618367 is going to be updated. [ 854.182229] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.187033] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.187033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.187033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.187283] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.187343] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.187469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d5a0052-c08a-45b1-aaf1-c99d18618367" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.304443] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b19db982-c704-4d3a-afb3-6084489072b4 [ 854.304889] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.304889] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.304889] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.305173] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.305235] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.305337] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b19db982-c704-4d3a-afb3-6084489072b4 already deleted. [ 854.305414] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b19db982-c704-4d3a-afb3-6084489072b4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.467336] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e541827f-5a38-4732-ac7b-f8cf25dc1ec1: rpc.has_security_group_logging(os_id): False [ 854.495613] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.495894] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.495994] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.496143] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.496246] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.496480] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.496598] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.496685] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.496819] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.497167] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.497167] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.497167] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.497414] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.497414] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.497504] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.497636] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.497736] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.497805] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.497927] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.498013] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.498112] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e541827f-5a38-4732-ac7b-f8cf25dc1ec1 is going to be created. [ 854.599417] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.599616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.599683] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.599936] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.600174] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.615164] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e541827f-5a38-4732-ac7b-f8cf25dc1ec1 in Status: IN_PROGRESS for 2s [ 854.685346] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.190520] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.190676] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.190749] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.190982] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.191089] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.191191] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f is going to be updated. [ 855.221892] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.221892] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.221892] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.221892] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.222239] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.233103] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: IN_PROGRESS for 2s [ 855.645672] env[70520]: INFO networking_nsxv3.common.synchronization [None req-b1d2c655-4346-4060-829f-9e367e3b2f61 None None] Enqueued Resource ID: 36ace9c3-4521-49d1-bc31-3b002ee3be58 with Priority: HIGHEST for action port [ 855.647058] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36ace9c3-4521-49d1-bc31-3b002ee3be58 with Priority: HIGHEST for action port [ 855.647402] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-36ace9c3-4521-49d1-bc31-3b002ee3be58 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.647527] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36ace9c3-4521-49d1-bc31-3b002ee3be58" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.647592] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36ace9c3-4521-49d1-bc31-3b002ee3be58" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.647859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36ace9c3-4521-49d1-bc31-3b002ee3be58" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.647938] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36ace9c3-4521-49d1-bc31-3b002ee3be58',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.080878] env[70520]: INFO networking_nsxv3.common.synchronization [None req-3d02d9f2-55f8-42bb-b347-9f2eafa11b6e None None] Enqueued Resource ID: 91097714-990a-48af-af56-95fa88f46618 with Priority: HIGHEST for action port [ 856.080878] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91097714-990a-48af-af56-95fa88f46618 with Priority: HIGHEST for action port [ 856.080878] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-91097714-990a-48af-af56-95fa88f46618 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.080878] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91097714-990a-48af-af56-95fa88f46618" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.082727] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91097714-990a-48af-af56-95fa88f46618" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.082727] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91097714-990a-48af-af56-95fa88f46618" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.082727] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91097714-990a-48af-af56-95fa88f46618',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.153350] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 36ace9c3-4521-49d1-bc31-3b002ee3be58 [ 856.154139] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.154139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.154139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.154406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.154406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.154477] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:36ace9c3-4521-49d1-bc31-3b002ee3be58 already deleted. [ 856.154597] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36ace9c3-4521-49d1-bc31-3b002ee3be58" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.584484] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 91097714-990a-48af-af56-95fa88f46618 [ 856.585190] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.585190] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.585190] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.585190] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.585410] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.585410] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:91097714-990a-48af-af56-95fa88f46618 already deleted. [ 856.585410] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91097714-990a-48af-af56-95fa88f46618" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.633336] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e541827f-5a38-4732-ac7b-f8cf25dc1ec1 in Status: SUCCESS [ 856.633872] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.753651] env[70520]: INFO networking_nsxv3.common.synchronization [req-edc64327-b37a-4601-b811-196faa566ee2 req-4397d837-7bb8-4523-a258-dca057b5b9a9 tempest-ServersTestFqdnHostnames-896096734 tempest-ServersTestFqdnHostnames-896096734-project-member] Enqueued Resource ID: 653491db-2944-4ea2-bef7-8e2800a4b41b with Priority: HIGHEST for action security_group_members [ 856.754234] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653491db-2944-4ea2-bef7-8e2800a4b41b with Priority: HIGHEST for action security_group_members [ 856.755120] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-653491db-2944-4ea2-bef7-8e2800a4b41b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.755287] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653491db-2944-4ea2-bef7-8e2800a4b41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.755656] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653491db-2944-4ea2-bef7-8e2800a4b41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.756366] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653491db-2944-4ea2-bef7-8e2800a4b41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.756690] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.756826] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.756949] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.757163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.757220] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.757318] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('653491db-2944-4ea2-bef7-8e2800a4b41b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.922479] env[70520]: INFO networking_nsxv3.common.synchronization [None req-853ea354-575c-4198-a57f-ba60a0f2c1ed tempest-AttachVolumeNegativeTest-1224878754 tempest-AttachVolumeNegativeTest-1224878754-project-member] Enqueued Resource ID: 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f with Priority: HIGHEST for action security_group_rules [ 856.923159] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f with Priority: HIGHEST for action security_group_rules [ 856.923491] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.923666] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.923733] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.924031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.924120] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8af5cf3c-e464-4241-82ec-9fc46dc5ae9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.183572] env[70520]: INFO networking_nsxv3.common.synchronization [None req-fb32e390-e84e-495d-b0e4-c9fafcfd9ca0 tempest-AttachVolumeNegativeTest-1224878754 tempest-AttachVolumeNegativeTest-1224878754-project-member] Enqueued Resource ID: 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f with Priority: HIGHEST for action security_group_rules [ 857.183572] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f with Priority: HIGHEST for action security_group_rules [ 857.185830] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.185830] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.248036] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: SUCCESS [ 857.248327] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.248965] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.249221] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.251386] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.251542] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.251601] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.251803] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.251893] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.251994] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.252554] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.260857] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.261058] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.261141] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.261414] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.261489] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.261912] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.261912] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.261912] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.262207] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.263077] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.263077] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 653491db-2944-4ea2-bef7-8e2800a4b41b already deleted. [ 857.263077] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653491db-2944-4ea2-bef7-8e2800a4b41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.305795] env[70520]: INFO networking_nsxv3.common.synchronization [req-42579cde-d827-4b27-a5ee-83a2247338d7 req-31c01602-3f56-4c10-bef7-f27919b18f87 tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 58197438-6dcb-404e-a8c1-aeacc2454958 with Priority: HIGHEST for action security_group_members [ 857.305856] env[70520]: INFO networking_nsxv3.common.synchronization [req-42579cde-d827-4b27-a5ee-83a2247338d7 req-31c01602-3f56-4c10-bef7-f27919b18f87 tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_members [ 857.307137] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58197438-6dcb-404e-a8c1-aeacc2454958 with Priority: HIGHEST for action security_group_members [ 857.307429] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_members [ 857.307735] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-58197438-6dcb-404e-a8c1-aeacc2454958 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.307850] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.307913] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.311040] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.311040] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.311040] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.311040] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.311040] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.311040] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.311040] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58197438-6dcb-404e-a8c1-aeacc2454958',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.311433] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.311433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.311433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.311579] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.311696] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.311773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.311820] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.311975] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.314722] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.314866] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.387180] env[70520]: INFO networking_nsxv3.common.synchronization [req-42579cde-d827-4b27-a5ee-83a2247338d7 req-31c01602-3f56-4c10-bef7-f27919b18f87 tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 58197438-6dcb-404e-a8c1-aeacc2454958 with Priority: HIGHEST for action security_group_rules [ 857.387851] env[70520]: INFO networking_nsxv3.common.synchronization [req-42579cde-d827-4b27-a5ee-83a2247338d7 req-31c01602-3f56-4c10-bef7-f27919b18f87 tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 58197438-6dcb-404e-a8c1-aeacc2454958 with Priority: HIGHEST for action security_group_members [ 857.387851] env[70520]: INFO networking_nsxv3.common.synchronization [req-42579cde-d827-4b27-a5ee-83a2247338d7 req-31c01602-3f56-4c10-bef7-f27919b18f87 tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_rules [ 857.387996] env[70520]: INFO networking_nsxv3.common.synchronization [req-42579cde-d827-4b27-a5ee-83a2247338d7 req-31c01602-3f56-4c10-bef7-f27919b18f87 tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_members [ 857.388200] env[70520]: INFO networking_nsxv3.common.synchronization [req-42579cde-d827-4b27-a5ee-83a2247338d7 req-31c01602-3f56-4c10-bef7-f27919b18f87 tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 974f8b65-96da-40a8-96a1-22a5d944e0dd with Priority: HIGHEST for action port [ 857.388864] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58197438-6dcb-404e-a8c1-aeacc2454958 with Priority: HIGHEST for action security_group_rules [ 857.389017] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_rules [ 857.389119] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 974f8b65-96da-40a8-96a1-22a5d944e0dd with Priority: HIGHEST for action port [ 857.389209] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58197438-6dcb-404e-a8c1-aeacc2454958 with Priority: HIGHEST for action security_group_members [ 857.389299] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_members [ 857.389661] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58197438-6dcb-404e-a8c1-aeacc2454958 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.389809] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.389870] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.390172] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.390254] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58197438-6dcb-404e-a8c1-aeacc2454958',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.391934] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.391934] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.391934] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.391934] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.391934] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.395642] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-974f8b65-96da-40a8-96a1-22a5d944e0dd taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.395642] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-974f8b65-96da-40a8-96a1-22a5d944e0dd" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.395642] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-974f8b65-96da-40a8-96a1-22a5d944e0dd" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.395642] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-974f8b65-96da-40a8-96a1-22a5d944e0dd" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.395642] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('974f8b65-96da-40a8-96a1-22a5d944e0dd',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.395642] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-58197438-6dcb-404e-a8c1-aeacc2454958 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.395642] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.395642] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.395642] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.448677] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.448814] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.448871] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.449176] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.449271] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.449364] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f already deleted. [ 857.449460] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.449934] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.450136] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.450226] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8af5cf3c-e464-4241-82ec-9fc46dc5ae9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.547238] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-155 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.547238] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-155" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.547238] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-155" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.549929] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-155" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.549929] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.549929] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.549929] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.549929] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.549929] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.549929] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 857.549929] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 857.549929] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 857.549929] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 857.549929] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 857.549929] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 857.549929] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 857.579198] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 857.579393] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 857.579545] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 857.579723] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-155" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.580058] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-e3a9fb6c-030f-4a74-8b96-11641a5ff59a taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.580228] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-e3a9fb6c-030f-4a74-8b96-11641a5ff59a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.580339] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-e3a9fb6c-030f-4a74-8b96-11641a5ff59a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.580716] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-e3a9fb6c-030f-4a74-8b96-11641a5ff59a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.580818] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3a9fb6c-030f-4a74-8b96-11641a5ff59a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.754747] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.756217] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.756217] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.756217] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.756217] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.756403] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.756403] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.756902] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.756902] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.756902] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.757181] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.757361] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.757456] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.757656] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.757912] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.758125] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.758243] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.758460] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.758608] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.758736] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.758952] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.819298] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58197438-6dcb-404e-a8c1-aeacc2454958',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.819298] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.895658] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-58197438-6dcb-404e-a8c1-aeacc2454958 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.896775] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.898234] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.898234] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.898234] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 974f8b65-96da-40a8-96a1-22a5d944e0dd with status ACTIVE [ 857.898234] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.898234] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.898234] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.898234] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.898234] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.898615] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.898615] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.898615] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.898705] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.898734] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.899171] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.899171] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.899171] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.899328] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.899328] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.899381] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 974f8b65-96da-40a8-96a1-22a5d944e0dd is going to be updated. [ 857.922861] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.923139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.923460] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.923716] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.923910] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.924136] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-974f8b65-96da-40a8-96a1-22a5d944e0dd" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.977847] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.978088] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.978696] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.978696] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.978696] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.978877] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f already deleted. [ 857.979035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.087487] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.087764] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.087924] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.090792] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.090792] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.090792] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port e3a9fb6c-030f-4a74-8b96-11641a5ff59a not found, creating... [ 858.090792] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.090792] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.090792] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.090792] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.090792] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.098715] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.098905] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.098945] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.099349] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.099502] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.099729] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: e3a9fb6c-030f-4a74-8b96-11641a5ff59a is going to be created. [ 858.133280] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.133280] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.134141] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.135140] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.135140] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.136324] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-e3a9fb6c-030f-4a74-8b96-11641a5ff59a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.265356] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 80751702-3cad-4ef3-af48-e8bd866c7e7f: rpc.has_security_group_logging(os_id): False [ 858.301514] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.301514] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.301514] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.301715] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.301754] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.305019] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.305019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.305019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.305019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.305019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.305019] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.305019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.305019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.306083] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.306083] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.306282] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.306417] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.306510] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.306618] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.308410] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.308410] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f is going to be updated. [ 858.322331] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58197438-6dcb-404e-a8c1-aeacc2454958',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.328322] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.400557] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.400557] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.400557] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.400557] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.400934] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.421921] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: IN_PROGRESS for 2s [ 858.783804] env[70520]: INFO networking_nsxv3.common.synchronization [None req-62583ab1-b9f1-4e9f-ae5a-15023c3db75d None None] Enqueued Resource ID: bb869b09-7dad-46f0-b543-23e8b86a85a9 with Priority: HIGHEST for action port [ 858.784434] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb869b09-7dad-46f0-b543-23e8b86a85a9 with Priority: HIGHEST for action port [ 858.784860] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb869b09-7dad-46f0-b543-23e8b86a85a9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.785030] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb869b09-7dad-46f0-b543-23e8b86a85a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.785102] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb869b09-7dad-46f0-b543-23e8b86a85a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.785367] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb869b09-7dad-46f0-b543-23e8b86a85a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.785476] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb869b09-7dad-46f0-b543-23e8b86a85a9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.824902] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.825716] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.826017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.826377] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.826616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.827965] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58197438-6dcb-404e-a8c1-aeacc2454958 is going to be created. [ 858.832576] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.832925] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.835022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.835022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.835022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.835022] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 is going to be updated. [ 858.859983] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.860298] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.860414] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.860706] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.861050] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.864238] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.864431] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.864520] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.864742] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.864904] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.877918] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: IN_PROGRESS for 2s [ 858.878896] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58197438-6dcb-404e-a8c1-aeacc2454958 in Status: UNINITIALIZED for 2s [ 858.998263] env[70520]: INFO networking_nsxv3.common.synchronization [req-edc64327-b37a-4601-b811-196faa566ee2 req-a3277fa9-e6ee-4327-a8e6-b1e100356c59 service nova] Enqueued Resource ID: 653491db-2944-4ea2-bef7-8e2800a4b41b with Priority: HIGHEST for action security_group_rules [ 858.998263] env[70520]: INFO networking_nsxv3.common.synchronization [req-edc64327-b37a-4601-b811-196faa566ee2 req-a3277fa9-e6ee-4327-a8e6-b1e100356c59 service nova] Enqueued Resource ID: 653491db-2944-4ea2-bef7-8e2800a4b41b with Priority: HIGHEST for action security_group_members [ 858.998263] env[70520]: INFO networking_nsxv3.common.synchronization [req-edc64327-b37a-4601-b811-196faa566ee2 req-a3277fa9-e6ee-4327-a8e6-b1e100356c59 service nova] Enqueued Resource ID: e3a9fb6c-030f-4a74-8b96-11641a5ff59a with Priority: HIGHEST for action port [ 858.999164] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653491db-2944-4ea2-bef7-8e2800a4b41b with Priority: HIGHEST for action security_group_rules [ 858.999771] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653491db-2944-4ea2-bef7-8e2800a4b41b with Priority: HIGHEST for action security_group_members [ 859.000284] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3a9fb6c-030f-4a74-8b96-11641a5ff59a with Priority: HIGHEST for action port [ 859.000853] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-653491db-2944-4ea2-bef7-8e2800a4b41b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.001229] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-653491db-2944-4ea2-bef7-8e2800a4b41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.001381] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-653491db-2944-4ea2-bef7-8e2800a4b41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.001674] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-653491db-2944-4ea2-bef7-8e2800a4b41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.001842] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('653491db-2944-4ea2-bef7-8e2800a4b41b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.003181] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-653491db-2944-4ea2-bef7-8e2800a4b41b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.004771] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653491db-2944-4ea2-bef7-8e2800a4b41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.006108] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653491db-2944-4ea2-bef7-8e2800a4b41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.006218] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653491db-2944-4ea2-bef7-8e2800a4b41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.006415] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.006535] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.006633] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.006766] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.006907] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.006978] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('653491db-2944-4ea2-bef7-8e2800a4b41b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.008019] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3a9fb6c-030f-4a74-8b96-11641a5ff59a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.008166] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3a9fb6c-030f-4a74-8b96-11641a5ff59a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.008238] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3a9fb6c-030f-4a74-8b96-11641a5ff59a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.008409] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3a9fb6c-030f-4a74-8b96-11641a5ff59a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.008486] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3a9fb6c-030f-4a74-8b96-11641a5ff59a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.288661] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb869b09-7dad-46f0-b543-23e8b86a85a9 [ 859.289029] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.289164] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.289164] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.289411] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.289549] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.289724] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb869b09-7dad-46f0-b543-23e8b86a85a9 already deleted. [ 859.289724] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb869b09-7dad-46f0-b543-23e8b86a85a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.302732] env[70520]: INFO networking_nsxv3.common.synchronization [req-d3846c2e-e0bb-4539-bf30-21d00d52cb3f req-4cf3ad83-615b-48e2-87ac-e814f75b3e36 tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_members [ 859.303263] env[70520]: INFO networking_nsxv3.common.synchronization [req-d3846c2e-e0bb-4539-bf30-21d00d52cb3f req-4cf3ad83-615b-48e2-87ac-e814f75b3e36 tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 58197438-6dcb-404e-a8c1-aeacc2454958 with Priority: HIGHEST for action security_group_members [ 859.303263] env[70520]: INFO networking_nsxv3.common.synchronization [req-d3846c2e-e0bb-4539-bf30-21d00d52cb3f req-4cf3ad83-615b-48e2-87ac-e814f75b3e36 tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 4cfd4659-cc60-4e40-83b3-09f036d8f58c with Priority: HIGHEST for action security_group_members [ 859.303753] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_members [ 859.306225] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58197438-6dcb-404e-a8c1-aeacc2454958 with Priority: HIGHEST for action security_group_members [ 859.306529] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cfd4659-cc60-4e40-83b3-09f036d8f58c with Priority: HIGHEST for action security_group_members [ 859.307512] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.307512] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.310897] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-58197438-6dcb-404e-a8c1-aeacc2454958 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.310897] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.310897] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cfd4659-cc60-4e40-83b3-09f036d8f58c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.310897] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cfd4659-cc60-4e40-83b3-09f036d8f58c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.310897] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cfd4659-cc60-4e40-83b3-09f036d8f58c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.310897] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cfd4659-cc60-4e40-83b3-09f036d8f58c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.310897] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.310897] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.310897] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.310897] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.310897] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.310897] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cfd4659-cc60-4e40-83b3-09f036d8f58c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.371864] env[70520]: INFO networking_nsxv3.common.synchronization [req-d3846c2e-e0bb-4539-bf30-21d00d52cb3f req-4cf3ad83-615b-48e2-87ac-e814f75b3e36 tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 4cfd4659-cc60-4e40-83b3-09f036d8f58c with Priority: HIGHEST for action security_group_rules [ 859.372187] env[70520]: INFO networking_nsxv3.common.synchronization [req-d3846c2e-e0bb-4539-bf30-21d00d52cb3f req-4cf3ad83-615b-48e2-87ac-e814f75b3e36 tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 4cfd4659-cc60-4e40-83b3-09f036d8f58c with Priority: HIGHEST for action security_group_members [ 859.372302] env[70520]: INFO networking_nsxv3.common.synchronization [req-d3846c2e-e0bb-4539-bf30-21d00d52cb3f req-4cf3ad83-615b-48e2-87ac-e814f75b3e36 tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 58197438-6dcb-404e-a8c1-aeacc2454958 with Priority: HIGHEST for action security_group_rules [ 859.372417] env[70520]: INFO networking_nsxv3.common.synchronization [req-d3846c2e-e0bb-4539-bf30-21d00d52cb3f req-4cf3ad83-615b-48e2-87ac-e814f75b3e36 tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 58197438-6dcb-404e-a8c1-aeacc2454958 with Priority: HIGHEST for action security_group_members [ 859.372542] env[70520]: INFO networking_nsxv3.common.synchronization [req-d3846c2e-e0bb-4539-bf30-21d00d52cb3f req-4cf3ad83-615b-48e2-87ac-e814f75b3e36 tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_rules [ 859.372703] env[70520]: INFO networking_nsxv3.common.synchronization [req-d3846c2e-e0bb-4539-bf30-21d00d52cb3f req-4cf3ad83-615b-48e2-87ac-e814f75b3e36 tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_members [ 859.372833] env[70520]: INFO networking_nsxv3.common.synchronization [req-d3846c2e-e0bb-4539-bf30-21d00d52cb3f req-4cf3ad83-615b-48e2-87ac-e814f75b3e36 tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 974f8b65-96da-40a8-96a1-22a5d944e0dd with Priority: HIGHEST for action port [ 859.373806] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cfd4659-cc60-4e40-83b3-09f036d8f58c with Priority: HIGHEST for action security_group_rules [ 859.373955] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58197438-6dcb-404e-a8c1-aeacc2454958 with Priority: HIGHEST for action security_group_rules [ 859.374070] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_members [ 859.374175] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 974f8b65-96da-40a8-96a1-22a5d944e0dd with Priority: HIGHEST for action port [ 859.374287] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_rules [ 859.374378] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cfd4659-cc60-4e40-83b3-09f036d8f58c with Priority: HIGHEST for action security_group_members [ 859.374463] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58197438-6dcb-404e-a8c1-aeacc2454958 with Priority: HIGHEST for action security_group_members [ 859.374774] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cfd4659-cc60-4e40-83b3-09f036d8f58c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.374900] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cfd4659-cc60-4e40-83b3-09f036d8f58c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.374967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cfd4659-cc60-4e40-83b3-09f036d8f58c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.375287] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cfd4659-cc60-4e40-83b3-09f036d8f58c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.375287] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cfd4659-cc60-4e40-83b3-09f036d8f58c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.375287] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58197438-6dcb-404e-a8c1-aeacc2454958 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.375287] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.375287] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.375287] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.375287] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-974f8b65-96da-40a8-96a1-22a5d944e0dd taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.375287] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-974f8b65-96da-40a8-96a1-22a5d944e0dd" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.375287] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-974f8b65-96da-40a8-96a1-22a5d944e0dd" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.375287] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-974f8b65-96da-40a8-96a1-22a5d944e0dd" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.375287] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('974f8b65-96da-40a8-96a1-22a5d944e0dd',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.380717] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.380717] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.380717] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cfd4659-cc60-4e40-83b3-09f036d8f58c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.380717] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cfd4659-cc60-4e40-83b3-09f036d8f58c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.380717] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-58197438-6dcb-404e-a8c1-aeacc2454958 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.380717] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.517287] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('653491db-2944-4ea2-bef7-8e2800a4b41b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.517551] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-653491db-2944-4ea2-bef7-8e2800a4b41b taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.517662] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653491db-2944-4ea2-bef7-8e2800a4b41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.517834] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e3a9fb6c-030f-4a74-8b96-11641a5ff59a with status ACTIVE [ 859.517991] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.518110] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.518173] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.518403] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.518496] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.518679] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.518905] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.518905] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.519038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.519114] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.519292] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.519384] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.519443] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.519604] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.519663] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.519726] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e3a9fb6c-030f-4a74-8b96-11641a5ff59a is going to be updated. [ 859.560295] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.561519] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.561686] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.562031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.562031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.562265] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3a9fb6c-030f-4a74-8b96-11641a5ff59a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.813085] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cfd4659-cc60-4e40-83b3-09f036d8f58c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.882314] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 974f8b65-96da-40a8-96a1-22a5d944e0dd with status ACTIVE [ 859.882314] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.882314] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.882314] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.882314] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.882314] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.882314] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.882745] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.882745] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.882745] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.882745] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.882990] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.883098] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.883155] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.883291] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.883360] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.883466] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 974f8b65-96da-40a8-96a1-22a5d944e0dd is going to be updated. [ 859.884779] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cfd4659-cc60-4e40-83b3-09f036d8f58c taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.884901] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cfd4659-cc60-4e40-83b3-09f036d8f58c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.907754] env[70520]: INFO networking_nsxv3.common.synchronization [None req-61334d41-e47e-440b-9992-70e2616cc00b tempest-ServerActionsTestOtherA-325270290 tempest-ServerActionsTestOtherA-325270290-project-member] Enqueued Resource ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 with Priority: HIGHEST for action security_group_rules [ 859.908542] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 with Priority: HIGHEST for action security_group_rules [ 859.910468] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0fc21783-a665-46f8-bdde-7d13f7923e03 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.910468] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.910468] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.910468] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.910468] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0fc21783-a665-46f8-bdde-7d13f7923e03',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.919084] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.919084] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.919084] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.919329] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.919536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.919731] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-974f8b65-96da-40a8-96a1-22a5d944e0dd" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.024462] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('653491db-2944-4ea2-bef7-8e2800a4b41b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.041231] env[70520]: INFO networking_nsxv3.common.synchronization [None req-bc72d74b-441c-4778-bd1d-0b1e1515dff8 tempest-ServerActionsTestOtherA-325270290 tempest-ServerActionsTestOtherA-325270290-project-member] Enqueued Resource ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 with Priority: HIGHEST for action security_group_rules [ 860.045031] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 with Priority: HIGHEST for action security_group_rules [ 860.045031] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0fc21783-a665-46f8-bdde-7d13f7923e03 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.045031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.316432] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cfd4659-cc60-4e40-83b3-09f036d8f58c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.417710] env[70520]: INFO networking_nsxv3.common.synchronization [None req-e4c2e92a-6b9f-4e28-ac1f-295f79b50e81 tempest-ImagesOneServerNegativeTestJSON-1115954637 tempest-ImagesOneServerNegativeTestJSON-1115954637-project-member] Enqueued Resource ID: defdfcd0-981e-4233-9716-6930a3ca934c with Priority: HIGHEST for action security_group_rules [ 860.418555] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: defdfcd0-981e-4233-9716-6930a3ca934c with Priority: HIGHEST for action security_group_rules [ 860.419331] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-defdfcd0-981e-4233-9716-6930a3ca934c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.419503] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-defdfcd0-981e-4233-9716-6930a3ca934c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.419587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-defdfcd0-981e-4233-9716-6930a3ca934c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.419785] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-defdfcd0-981e-4233-9716-6930a3ca934c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.419871] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('defdfcd0-981e-4233-9716-6930a3ca934c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.436958] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.437143] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.437189] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.437671] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.437770] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.437866] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 already deleted. [ 860.437952] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.438972] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.439170] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.439257] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0fc21783-a665-46f8-bdde-7d13f7923e03',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.440676] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: SUCCESS [ 860.440869] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.526689] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.526871] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.526962] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.527208] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.527327] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.527419] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 653491db-2944-4ea2-bef7-8e2800a4b41b is going to be created. [ 860.547778] env[70520]: INFO networking_nsxv3.common.synchronization [None req-16a361e4-0864-4f44-996f-f9b1c0210b98 tempest-ImagesOneServerNegativeTestJSON-1115954637 tempest-ImagesOneServerNegativeTestJSON-1115954637-project-member] Enqueued Resource ID: defdfcd0-981e-4233-9716-6930a3ca934c with Priority: HIGHEST for action security_group_rules [ 860.548356] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: defdfcd0-981e-4233-9716-6930a3ca934c with Priority: HIGHEST for action security_group_rules [ 860.548653] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-defdfcd0-981e-4233-9716-6930a3ca934c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.548757] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-defdfcd0-981e-4233-9716-6930a3ca934c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.554845] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.554845] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.554845] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.555203] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.555294] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.565068] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653491db-2944-4ea2-bef7-8e2800a4b41b in Status: UNINITIALIZED for 2s [ 860.819414] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.819709] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.819709] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.819900] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.819931] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.820039] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cfd4659-cc60-4e40-83b3-09f036d8f58c is going to be created. [ 860.845115] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.845290] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.845333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.845730] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.845990] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.859143] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cfd4659-cc60-4e40-83b3-09f036d8f58c in Status: UNINITIALIZED for 2s [ 860.888995] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: SUCCESS [ 860.889331] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.889702] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.889870] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.890136] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.890317] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.890456] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.890648] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.890768] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.890908] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.893693] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58197438-6dcb-404e-a8c1-aeacc2454958 in Status: SUCCESS [ 860.893792] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.895504] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.896150] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.896431] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.896606] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.896713] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.898253] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.898380] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.898536] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58197438-6dcb-404e-a8c1-aeacc2454958',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.951149] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.951149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.951149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.951149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.951149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.951149] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: defdfcd0-981e-4233-9716-6930a3ca934c already deleted. [ 860.951149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-defdfcd0-981e-4233-9716-6930a3ca934c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.951149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-defdfcd0-981e-4233-9716-6930a3ca934c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.951149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-defdfcd0-981e-4233-9716-6930a3ca934c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.951149] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('defdfcd0-981e-4233-9716-6930a3ca934c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.966112] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.966112] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.966301] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.966518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.966518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.966580] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 already deleted. [ 860.966648] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.217248] env[70520]: INFO networking_nsxv3.common.synchronization [req-13121bca-df4d-4b30-92b6-1a7a79eff4aa req-b184aacd-2428-481a-9dae-a995f533c745 tempest-MigrationsAdminTest-360924409 tempest-MigrationsAdminTest-360924409-project-member] Enqueued Resource ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 with Priority: HIGHEST for action security_group_members [ 861.217248] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 with Priority: HIGHEST for action security_group_members [ 861.217248] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f391db-1908-4d0d-afa1-a1da6f6944f6 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.217248] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.217248] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.217248] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.217248] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.217248] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.217248] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.217248] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.217248] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.217248] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17f391db-1908-4d0d-afa1-a1da6f6944f6',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.403766] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58197438-6dcb-404e-a8c1-aeacc2454958',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.404185] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.478295] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.478295] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.478295] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.478295] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.478295] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.478295] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: defdfcd0-981e-4233-9716-6930a3ca934c already deleted. [ 861.478295] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-defdfcd0-981e-4233-9716-6930a3ca934c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.604079] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-659 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.604335] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.604461] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.604727] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.605000] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.605610] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.605734] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.606106] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.606252] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.606466] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 861.606574] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 861.609018] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 861.609018] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 861.609018] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 861.609018] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 861.609018] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 861.638317] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 861.638414] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 861.638587] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 861.638793] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-659" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.639197] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-707b3985-2191-4a9c-bbfe-1922ac3dfbce taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.639389] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-707b3985-2191-4a9c-bbfe-1922ac3dfbce" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.639504] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-707b3985-2191-4a9c-bbfe-1922ac3dfbce" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.639909] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-707b3985-2191-4a9c-bbfe-1922ac3dfbce" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.640187] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('707b3985-2191-4a9c-bbfe-1922ac3dfbce',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.721672] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17f391db-1908-4d0d-afa1-a1da6f6944f6',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.905898] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58197438-6dcb-404e-a8c1-aeacc2454958',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.909108] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.144484] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.144683] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.145256] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.145256] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.145424] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.145627] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 707b3985-2191-4a9c-bbfe-1922ac3dfbce not found, creating... [ 862.146105] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.146378] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.146562] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.146900] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.147112] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.147570] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.147796] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.147962] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.148280] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.148465] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.148656] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 707b3985-2191-4a9c-bbfe-1922ac3dfbce is going to be created. [ 862.171880] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.172249] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.172307] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.172644] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.172883] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.173119] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-707b3985-2191-4a9c-bbfe-1922ac3dfbce" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.225900] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17f391db-1908-4d0d-afa1-a1da6f6944f6',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.413118] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.413329] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.413408] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.413631] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.413740] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.413851] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58197438-6dcb-404e-a8c1-aeacc2454958 is going to be updated. [ 862.415257] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.415492] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.415565] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.415748] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.415893] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.416009] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 is going to be updated. [ 862.448189] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.448189] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.448189] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.448553] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.448698] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.452412] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.452412] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.452584] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.452752] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.452832] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.464914] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: IN_PROGRESS for 2s [ 862.466171] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58197438-6dcb-404e-a8c1-aeacc2454958 in Status: IN_PROGRESS for 2s [ 862.589209] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653491db-2944-4ea2-bef7-8e2800a4b41b in Status: SUCCESS [ 862.589209] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653491db-2944-4ea2-bef7-8e2800a4b41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.589209] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653491db-2944-4ea2-bef7-8e2800a4b41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.589209] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653491db-2944-4ea2-bef7-8e2800a4b41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.589209] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.589209] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.589560] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.589707] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.589812] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.589947] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653491db-2944-4ea2-bef7-8e2800a4b41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.590080] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('653491db-2944-4ea2-bef7-8e2800a4b41b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.731560] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.731560] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.731560] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.731560] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.731560] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.731560] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 is going to be updated. [ 862.764889] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.765538] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.765643] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.766058] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.766742] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.780500] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 in Status: IN_PROGRESS for 2s [ 862.870305] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cfd4659-cc60-4e40-83b3-09f036d8f58c in Status: SUCCESS [ 862.870584] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cfd4659-cc60-4e40-83b3-09f036d8f58c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.870806] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cfd4659-cc60-4e40-83b3-09f036d8f58c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.875020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cfd4659-cc60-4e40-83b3-09f036d8f58c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.875020] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.875020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.875020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.875020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.875020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.875020] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cfd4659-cc60-4e40-83b3-09f036d8f58c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.094316] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('653491db-2944-4ea2-bef7-8e2800a4b41b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.290091] env[70520]: INFO networking_nsxv3.common.synchronization [req-13121bca-df4d-4b30-92b6-1a7a79eff4aa req-ed5f036d-0ea8-49ce-920c-3352a8d585b4 service nova] Enqueued Resource ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 with Priority: HIGHEST for action security_group_rules [ 863.291030] env[70520]: INFO networking_nsxv3.common.synchronization [req-13121bca-df4d-4b30-92b6-1a7a79eff4aa req-ed5f036d-0ea8-49ce-920c-3352a8d585b4 service nova] Enqueued Resource ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 with Priority: HIGHEST for action security_group_members [ 863.291855] env[70520]: INFO networking_nsxv3.common.synchronization [req-13121bca-df4d-4b30-92b6-1a7a79eff4aa req-ed5f036d-0ea8-49ce-920c-3352a8d585b4 service nova] Enqueued Resource ID: 707b3985-2191-4a9c-bbfe-1922ac3dfbce with Priority: HIGHEST for action port [ 863.292506] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 with Priority: HIGHEST for action security_group_rules [ 863.292664] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 with Priority: HIGHEST for action security_group_members [ 863.292896] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 707b3985-2191-4a9c-bbfe-1922ac3dfbce with Priority: HIGHEST for action port [ 863.293211] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17f391db-1908-4d0d-afa1-a1da6f6944f6 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.293397] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.293505] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.293802] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.293900] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17f391db-1908-4d0d-afa1-a1da6f6944f6',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.296019] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f391db-1908-4d0d-afa1-a1da6f6944f6 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.296019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.296019] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-707b3985-2191-4a9c-bbfe-1922ac3dfbce taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.296019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-707b3985-2191-4a9c-bbfe-1922ac3dfbce" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.296019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-707b3985-2191-4a9c-bbfe-1922ac3dfbce" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.296019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-707b3985-2191-4a9c-bbfe-1922ac3dfbce" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.296019] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('707b3985-2191-4a9c-bbfe-1922ac3dfbce',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.376795] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cfd4659-cc60-4e40-83b3-09f036d8f58c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.600141] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 653491db-2944-4ea2-bef7-8e2800a4b41b: rpc.has_security_group_logging(os_id): False [ 863.625835] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.626071] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.626272] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.626331] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.627033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.627033] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.627033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.627033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.627278] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.627278] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.627278] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 653491db-2944-4ea2-bef7-8e2800a4b41b is going to be created. [ 863.694566] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.694566] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.694566] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.694566] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.694947] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.708042] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 653491db-2944-4ea2-bef7-8e2800a4b41b in Status: IN_PROGRESS for 2s [ 863.798014] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f391db-1908-4d0d-afa1-a1da6f6944f6 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.798014] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.798282] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 707b3985-2191-4a9c-bbfe-1922ac3dfbce with status ACTIVE [ 863.798282] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.798371] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.798406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.798602] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.798689] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.798851] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.798946] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.799015] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.799175] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.799252] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.799424] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.799516] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.799576] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.800604] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.800696] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.800787] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 707b3985-2191-4a9c-bbfe-1922ac3dfbce is going to be updated. [ 863.829020] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.829020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.829020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.829291] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.829435] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.829570] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-707b3985-2191-4a9c-bbfe-1922ac3dfbce" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.882666] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cfd4659-cc60-4e40-83b3-09f036d8f58c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.386438] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.386755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.386755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.386949] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.386949] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.387046] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cfd4659-cc60-4e40-83b3-09f036d8f58c is going to be updated. [ 864.418831] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.418978] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.419060] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.419271] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.419419] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.430514] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cfd4659-cc60-4e40-83b3-09f036d8f58c in Status: IN_PROGRESS for 2s [ 864.476434] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58197438-6dcb-404e-a8c1-aeacc2454958 in Status: SUCCESS [ 864.476698] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.477480] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: SUCCESS [ 864.477680] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.477993] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.478193] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.478442] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.478568] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.478647] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.478798] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.478878] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.478977] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.479067] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58197438-6dcb-404e-a8c1-aeacc2454958',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.480057] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.480057] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.480251] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.480359] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.480521] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.480636] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.480965] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.480965] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.480965] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.484948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.484948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.484948] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.484948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.484948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.484948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.484948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.484948] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58197438-6dcb-404e-a8c1-aeacc2454958',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.484948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.484948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.484948] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.484948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.484948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.484948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.484948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.484948] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.790530] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 in Status: SUCCESS [ 864.790751] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.790979] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.791239] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.791458] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.791604] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.791680] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.791861] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.791969] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.792109] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17f391db-1908-4d0d-afa1-a1da6f6944f6',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.987172] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58197438-6dcb-404e-a8c1-aeacc2454958',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.990242] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.990242] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.990242] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.990242] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58197438-6dcb-404e-a8c1-aeacc2454958',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.294766] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17f391db-1908-4d0d-afa1-a1da6f6944f6',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.492864] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58197438-6dcb-404e-a8c1-aeacc2454958: rpc.has_security_group_logging(os_id): False [ 865.494176] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.495283] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58197438-6dcb-404e-a8c1-aeacc2454958',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.514921] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.515136] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.515468] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.515743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.516289] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.516289] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.516465] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.516465] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.516677] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.517012] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.517163] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58197438-6dcb-404e-a8c1-aeacc2454958 is going to be created. [ 865.612415] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.612646] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.612758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.613170] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.613393] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.628552] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58197438-6dcb-404e-a8c1-aeacc2454958 in Status: IN_PROGRESS for 2s [ 865.734802] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 653491db-2944-4ea2-bef7-8e2800a4b41b in Status: SUCCESS [ 865.734802] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-653491db-2944-4ea2-bef7-8e2800a4b41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.798303] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17f391db-1908-4d0d-afa1-a1da6f6944f6',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.906431] env[70520]: INFO networking_nsxv3.common.synchronization [req-1bed467d-8571-4a06-8308-dfb0bc41f42b req-3fb85f2a-6cf2-4705-a955-1faaf8f06919 tempest-ServerRescueTestJSONUnderV235-1054354334 tempest-ServerRescueTestJSONUnderV235-1054354334-project-member] Enqueued Resource ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 with Priority: HIGHEST for action security_group_members [ 865.906431] env[70520]: INFO networking_nsxv3.common.synchronization [req-1bed467d-8571-4a06-8308-dfb0bc41f42b req-3fb85f2a-6cf2-4705-a955-1faaf8f06919 tempest-ServerRescueTestJSONUnderV235-1054354334 tempest-ServerRescueTestJSONUnderV235-1054354334-project-member] Enqueued Resource ID: 8b6467c7-f124-4efd-a762-76ed86421331 with Priority: HIGHEST for action security_group_members [ 865.906431] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 with Priority: HIGHEST for action security_group_members [ 865.906431] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b6467c7-f124-4efd-a762-76ed86421331 with Priority: HIGHEST for action security_group_members [ 865.907876] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.907876] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.907876] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.907876] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.908061] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.908202] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.908994] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.909644] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.909644] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.909644] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92a0a3db-a366-45d6-b0b8-a9a2b4be13d4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.910581] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b6467c7-f124-4efd-a762-76ed86421331 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.910581] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b6467c7-f124-4efd-a762-76ed86421331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.910868] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b6467c7-f124-4efd-a762-76ed86421331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.910868] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b6467c7-f124-4efd-a762-76ed86421331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.910994] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.911106] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.911188] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.911446] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.911588] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.911588] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b6467c7-f124-4efd-a762-76ed86421331',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.951440] env[70520]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] NSXv3 Agent Agent loop - iteration:0 completed [ 865.951902] env[70520]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] NSXv3 Agent Agent loop - iteration:1 started [ 865.999073] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.999073] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.999073] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.999073] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.999073] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.999073] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 is going to be updated. [ 865.999896] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.000522] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.000610] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.001108] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.001295] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.001406] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58197438-6dcb-404e-a8c1-aeacc2454958 is going to be updated. [ 866.008412] env[70520]: INFO networking_nsxv3.common.synchronization [req-1bed467d-8571-4a06-8308-dfb0bc41f42b req-3fb85f2a-6cf2-4705-a955-1faaf8f06919 tempest-ServerRescueTestJSONUnderV235-1054354334 tempest-ServerRescueTestJSONUnderV235-1054354334-project-member] Enqueued Resource ID: 8b6467c7-f124-4efd-a762-76ed86421331 with Priority: HIGHEST for action security_group_rules [ 866.008594] env[70520]: INFO networking_nsxv3.common.synchronization [req-1bed467d-8571-4a06-8308-dfb0bc41f42b req-3fb85f2a-6cf2-4705-a955-1faaf8f06919 tempest-ServerRescueTestJSONUnderV235-1054354334 tempest-ServerRescueTestJSONUnderV235-1054354334-project-member] Enqueued Resource ID: 8b6467c7-f124-4efd-a762-76ed86421331 with Priority: HIGHEST for action security_group_members [ 866.009610] env[70520]: INFO networking_nsxv3.common.synchronization [req-1bed467d-8571-4a06-8308-dfb0bc41f42b req-3fb85f2a-6cf2-4705-a955-1faaf8f06919 tempest-ServerRescueTestJSONUnderV235-1054354334 tempest-ServerRescueTestJSONUnderV235-1054354334-project-member] Enqueued Resource ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 with Priority: HIGHEST for action security_group_rules [ 866.009799] env[70520]: INFO networking_nsxv3.common.synchronization [req-1bed467d-8571-4a06-8308-dfb0bc41f42b req-3fb85f2a-6cf2-4705-a955-1faaf8f06919 tempest-ServerRescueTestJSONUnderV235-1054354334 tempest-ServerRescueTestJSONUnderV235-1054354334-project-member] Enqueued Resource ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 with Priority: HIGHEST for action security_group_members [ 866.010131] env[70520]: INFO networking_nsxv3.common.synchronization [req-1bed467d-8571-4a06-8308-dfb0bc41f42b req-3fb85f2a-6cf2-4705-a955-1faaf8f06919 tempest-ServerRescueTestJSONUnderV235-1054354334 tempest-ServerRescueTestJSONUnderV235-1054354334-project-member] Enqueued Resource ID: 1f1a0487-973c-4614-ae20-da574807de9c with Priority: HIGHEST for action port [ 866.012557] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b6467c7-f124-4efd-a762-76ed86421331 with Priority: HIGHEST for action security_group_rules [ 866.014015] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 with Priority: HIGHEST for action security_group_rules [ 866.014015] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f1a0487-973c-4614-ae20-da574807de9c with Priority: HIGHEST for action port [ 866.014015] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b6467c7-f124-4efd-a762-76ed86421331 with Priority: HIGHEST for action security_group_members [ 866.014015] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 with Priority: HIGHEST for action security_group_members [ 866.014015] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b6467c7-f124-4efd-a762-76ed86421331 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.014015] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b6467c7-f124-4efd-a762-76ed86421331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.014015] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b6467c7-f124-4efd-a762-76ed86421331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.014015] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b6467c7-f124-4efd-a762-76ed86421331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.014015] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b6467c7-f124-4efd-a762-76ed86421331',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.015011] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.015153] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.015229] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.015451] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.015537] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92a0a3db-a366-45d6-b0b8-a9a2b4be13d4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.017057] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f1a0487-973c-4614-ae20-da574807de9c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.017057] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f1a0487-973c-4614-ae20-da574807de9c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.017200] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f1a0487-973c-4614-ae20-da574807de9c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.017374] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f1a0487-973c-4614-ae20-da574807de9c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.017455] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f1a0487-973c-4614-ae20-da574807de9c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.019138] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b6467c7-f124-4efd-a762-76ed86421331 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.019138] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b6467c7-f124-4efd-a762-76ed86421331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.019330] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.019330] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.046971] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.046971] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.046971] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.046971] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.046971] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.054014] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.054014] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.054014] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.054014] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.054231] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.073928] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58197438-6dcb-404e-a8c1-aeacc2454958 in Status: IN_PROGRESS for 2s [ 866.073928] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: IN_PROGRESS for 2s [ 866.171200] env[70520]: INFO networking_nsxv3.common.synchronization [req-9551a018-d6e0-4ac1-b45a-efbee98acf2f req-8357e093-4e1c-4957-95d7-7a6f3013b277 tempest-VolumesAdminNegativeTest-725810316 tempest-VolumesAdminNegativeTest-725810316-project-member] Enqueued Resource ID: f07f408b-d949-4e30-bfe4-08c3628f17de with Priority: HIGHEST for action security_group_members [ 866.171558] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f07f408b-d949-4e30-bfe4-08c3628f17de with Priority: HIGHEST for action security_group_members [ 866.172071] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f07f408b-d949-4e30-bfe4-08c3628f17de taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.173255] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.174991] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.180518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.180518] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.180518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.180518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.180518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.180518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.180518] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f07f408b-d949-4e30-bfe4-08c3628f17de',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.300076] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.300196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.300270] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.300485] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.300612] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.300724] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 is going to be updated. [ 866.348809] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.349017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.349058] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.349252] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.349402] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.360331] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 in Status: IN_PROGRESS for 2s [ 866.413510] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92a0a3db-a366-45d6-b0b8-a9a2b4be13d4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.414813] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b6467c7-f124-4efd-a762-76ed86421331',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.441085] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cfd4659-cc60-4e40-83b3-09f036d8f58c in Status: SUCCESS [ 866.441231] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cfd4659-cc60-4e40-83b3-09f036d8f58c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.441392] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cfd4659-cc60-4e40-83b3-09f036d8f58c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.441605] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cfd4659-cc60-4e40-83b3-09f036d8f58c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.441795] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.441908] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.441971] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.442127] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.442203] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.442400] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cfd4659-cc60-4e40-83b3-09f036d8f58c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.442400] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4cfd4659-cc60-4e40-83b3-09f036d8f58c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.520949] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.521385] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.521385] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b6467c7-f124-4efd-a762-76ed86421331 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.521385] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b6467c7-f124-4efd-a762-76ed86421331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.521569] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f1a0487-973c-4614-ae20-da574807de9c with status ACTIVE [ 866.521763] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.521763] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.521941] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.522035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.522126] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.522292] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.522385] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.522441] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.522591] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.522662] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.522840] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.522916] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.522976] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.523165] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.523240] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.523277] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f1a0487-973c-4614-ae20-da574807de9c is going to be updated. [ 866.549374] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.549597] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.549597] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.550381] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.550533] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.550711] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f1a0487-973c-4614-ae20-da574807de9c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.614843] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-23 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.615060] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.615186] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.615452] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.615718] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.615912] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.617283] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.617608] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.617770] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.617995] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 866.618123] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 866.618258] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 866.618471] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 866.618579] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 866.618632] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 866.618735] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 866.646653] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 866.646898] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 866.646978] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 866.647205] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.647535] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-2aec538b-642f-426b-a2d3-308c05c721e6 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.647709] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-2aec538b-642f-426b-a2d3-308c05c721e6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.647828] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-2aec538b-642f-426b-a2d3-308c05c721e6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.648885] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-2aec538b-642f-426b-a2d3-308c05c721e6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.648885] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2aec538b-642f-426b-a2d3-308c05c721e6',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.681937] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.682319] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.682396] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.682637] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.682730] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.682934] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.683052] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.683115] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.683269] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.683344] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.683428] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f07f408b-d949-4e30-bfe4-08c3628f17de already deleted. [ 866.683505] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.921599] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92a0a3db-a366-45d6-b0b8-a9a2b4be13d4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.922996] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b6467c7-f124-4efd-a762-76ed86421331',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.945401] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4cfd4659-cc60-4e40-83b3-09f036d8f58c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.151422] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.151576] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.151773] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.151903] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.153805] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.153805] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 2aec538b-642f-426b-a2d3-308c05c721e6 not found, creating... [ 867.153805] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.153805] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.153805] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.154313] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.154313] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.154411] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.157131] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.157131] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.157131] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.157131] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.157131] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 2aec538b-642f-426b-a2d3-308c05c721e6 is going to be created. [ 867.179377] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.179582] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.179707] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.179992] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.180239] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.180476] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-2aec538b-642f-426b-a2d3-308c05c721e6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.426077] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.426309] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.426391] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.426606] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.426700] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.426799] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 is going to be updated. [ 867.429526] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.429648] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.429719] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.429906] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.429993] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.431282] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b6467c7-f124-4efd-a762-76ed86421331 is going to be created. [ 867.447307] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4cfd4659-cc60-4e40-83b3-09f036d8f58c: rpc.has_security_group_logging(os_id): False [ 867.455301] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.455443] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.455724] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.456080] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.456265] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.461706] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.461706] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.461706] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.461706] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.461706] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.473789] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 in Status: IN_PROGRESS for 2s [ 867.474719] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b6467c7-f124-4efd-a762-76ed86421331 in Status: UNINITIALIZED for 2s [ 867.477093] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.477261] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.477392] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.477627] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.477720] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.478062] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.478189] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.478268] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.478458] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.478723] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.478822] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cfd4659-cc60-4e40-83b3-09f036d8f58c is going to be created. [ 867.535314] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.535692] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.535692] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.535763] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.536050] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.546993] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cfd4659-cc60-4e40-83b3-09f036d8f58c in Status: IN_PROGRESS for 2s [ 867.649211] env[70520]: INFO networking_nsxv3.common.synchronization [req-d4ca9173-a3fe-4991-bb7d-fe97eda4180f req-b836247f-2e9f-4345-a634-e0e611b3a0d0 tempest-ServerRescueTestJSONUnderV235-1054354334 tempest-ServerRescueTestJSONUnderV235-1054354334-project-member] Enqueued Resource ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 with Priority: HIGHEST for action security_group_members [ 867.649211] env[70520]: INFO networking_nsxv3.common.synchronization [req-d4ca9173-a3fe-4991-bb7d-fe97eda4180f req-b836247f-2e9f-4345-a634-e0e611b3a0d0 tempest-ServerRescueTestJSONUnderV235-1054354334 tempest-ServerRescueTestJSONUnderV235-1054354334-project-member] Enqueued Resource ID: 8b6467c7-f124-4efd-a762-76ed86421331 with Priority: HIGHEST for action security_group_members [ 867.649817] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58197438-6dcb-404e-a8c1-aeacc2454958 in Status: SUCCESS [ 867.650042] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.652207] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 with Priority: HIGHEST for action security_group_members [ 867.652207] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b6467c7-f124-4efd-a762-76ed86421331 with Priority: HIGHEST for action security_group_members [ 867.652207] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.652207] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.652207] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58197438-6dcb-404e-a8c1-aeacc2454958',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.655646] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.655646] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.655646] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b6467c7-f124-4efd-a762-76ed86421331 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.655824] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b6467c7-f124-4efd-a762-76ed86421331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.820510] env[70520]: INFO networking_nsxv3.common.synchronization [req-d4ca9173-a3fe-4991-bb7d-fe97eda4180f req-b836247f-2e9f-4345-a634-e0e611b3a0d0 tempest-ServerRescueTestJSONUnderV235-1054354334 tempest-ServerRescueTestJSONUnderV235-1054354334-project-member] Enqueued Resource ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 with Priority: HIGHEST for action security_group_rules [ 867.820855] env[70520]: INFO networking_nsxv3.common.synchronization [req-d4ca9173-a3fe-4991-bb7d-fe97eda4180f req-b836247f-2e9f-4345-a634-e0e611b3a0d0 tempest-ServerRescueTestJSONUnderV235-1054354334 tempest-ServerRescueTestJSONUnderV235-1054354334-project-member] Enqueued Resource ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 with Priority: HIGHEST for action security_group_members [ 867.820965] env[70520]: INFO networking_nsxv3.common.synchronization [req-d4ca9173-a3fe-4991-bb7d-fe97eda4180f req-b836247f-2e9f-4345-a634-e0e611b3a0d0 tempest-ServerRescueTestJSONUnderV235-1054354334 tempest-ServerRescueTestJSONUnderV235-1054354334-project-member] Enqueued Resource ID: 1f1a0487-973c-4614-ae20-da574807de9c with Priority: HIGHEST for action port [ 867.821524] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 with Priority: HIGHEST for action security_group_rules [ 867.821693] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 with Priority: HIGHEST for action security_group_members [ 867.821815] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f1a0487-973c-4614-ae20-da574807de9c with Priority: HIGHEST for action port [ 867.822395] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.822585] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.822870] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.822984] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.823496] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f1a0487-973c-4614-ae20-da574807de9c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.823496] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f1a0487-973c-4614-ae20-da574807de9c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.823496] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f1a0487-973c-4614-ae20-da574807de9c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.824051] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f1a0487-973c-4614-ae20-da574807de9c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.824051] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f1a0487-973c-4614-ae20-da574807de9c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.952296] env[70520]: INFO networking_nsxv3.common.synchronization [req-9551a018-d6e0-4ac1-b45a-efbee98acf2f req-6de423c6-8af1-4af6-a8b3-9a22a1512a31 service nova] Enqueued Resource ID: f07f408b-d949-4e30-bfe4-08c3628f17de with Priority: HIGHEST for action security_group_rules [ 867.952475] env[70520]: INFO networking_nsxv3.common.synchronization [req-9551a018-d6e0-4ac1-b45a-efbee98acf2f req-6de423c6-8af1-4af6-a8b3-9a22a1512a31 service nova] Enqueued Resource ID: f07f408b-d949-4e30-bfe4-08c3628f17de with Priority: HIGHEST for action security_group_members [ 867.952614] env[70520]: INFO networking_nsxv3.common.synchronization [req-9551a018-d6e0-4ac1-b45a-efbee98acf2f req-6de423c6-8af1-4af6-a8b3-9a22a1512a31 service nova] Enqueued Resource ID: 2aec538b-642f-426b-a2d3-308c05c721e6 with Priority: HIGHEST for action port [ 867.952848] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f07f408b-d949-4e30-bfe4-08c3628f17de with Priority: HIGHEST for action security_group_rules [ 867.952974] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f07f408b-d949-4e30-bfe4-08c3628f17de with Priority: HIGHEST for action security_group_members [ 867.953084] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aec538b-642f-426b-a2d3-308c05c721e6 with Priority: HIGHEST for action port [ 867.953643] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f07f408b-d949-4e30-bfe4-08c3628f17de taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.953747] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.953903] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.958421] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.958569] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f07f408b-d949-4e30-bfe4-08c3628f17de',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.959780] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f07f408b-d949-4e30-bfe4-08c3628f17de taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.959911] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.959979] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.960181] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.960337] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.960548] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.960548] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.960660] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.960691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.960784] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f07f408b-d949-4e30-bfe4-08c3628f17de',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.961551] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-2aec538b-642f-426b-a2d3-308c05c721e6 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.961646] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2aec538b-642f-426b-a2d3-308c05c721e6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.961697] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2aec538b-642f-426b-a2d3-308c05c721e6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.961840] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2aec538b-642f-426b-a2d3-308c05c721e6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.961905] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2aec538b-642f-426b-a2d3-308c05c721e6',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.083622] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58197438-6dcb-404e-a8c1-aeacc2454958 in Status: SUCCESS [ 868.083872] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.084055] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.084292] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.084473] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.084587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.084645] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.084793] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.084872] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.084971] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58197438-6dcb-404e-a8c1-aeacc2454958',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.089011] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: SUCCESS [ 868.089213] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.089365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.089527] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.089892] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.090024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.090098] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.090248] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.090329] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.090449] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.156461] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-58197438-6dcb-404e-a8c1-aeacc2454958 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.156586] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.327293] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f1a0487-973c-4614-ae20-da574807de9c with status ACTIVE [ 868.327552] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.327705] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.327794] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.328041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.328232] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.328389] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.328682] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.328770] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.329046] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.329210] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.329471] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.329607] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.329691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.329862] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.329967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.330122] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f1a0487-973c-4614-ae20-da574807de9c is going to be updated. [ 868.354543] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.354816] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.354816] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.355168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.355406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.355655] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f1a0487-973c-4614-ae20-da574807de9c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.380305] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 in Status: SUCCESS [ 868.380305] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.380305] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.380632] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.380847] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.380933] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.380983] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.381219] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.381333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.381383] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.381441] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17f391db-1908-4d0d-afa1-a1da6f6944f6',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.467026] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f07f408b-d949-4e30-bfe4-08c3628f17de taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.467026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.467026] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f07f408b-d949-4e30-bfe4-08c3628f17de',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.467026] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2aec538b-642f-426b-a2d3-308c05c721e6 with status ACTIVE [ 868.467026] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.467026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.467026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.467026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.467026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.471859] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.471859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.471859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.472826] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.472826] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.472826] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.472826] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.472826] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.472826] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.472826] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.472826] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2aec538b-642f-426b-a2d3-308c05c721e6 is going to be updated. [ 868.495078] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.495309] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.495414] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.495673] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.495880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.496107] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2aec538b-642f-426b-a2d3-308c05c721e6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.592749] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58197438-6dcb-404e-a8c1-aeacc2454958',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.593687] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.886531] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f391db-1908-4d0d-afa1-a1da6f6944f6 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.886531] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.886531] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.886531] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.886531] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.886531] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.886531] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.887316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.887316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.887316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.887316] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f391db-1908-4d0d-afa1-a1da6f6944f6 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.887316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.887492] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.887532] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.887757] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.887872] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.887957] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.888624] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.888709] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.892020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.892020] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17f391db-1908-4d0d-afa1-a1da6f6944f6',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.976191] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f07f408b-d949-4e30-bfe4-08c3628f17de',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.095828] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58197438-6dcb-404e-a8c1-aeacc2454958',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.097840] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.392733] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17f391db-1908-4d0d-afa1-a1da6f6944f6: rpc.has_security_group_logging(os_id): False [ 869.416325] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.416526] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.416526] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.418833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.418833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.418833] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.418833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.418833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.418833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.418833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.418833] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.418833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.418833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.418833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.418833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.418833] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.418833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.419367] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.419367] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.419367] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.419367] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 is going to be updated. [ 869.478901] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.479842] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.479842] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.479842] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.479842] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.479842] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f07f408b-d949-4e30-bfe4-08c3628f17de is going to be created. [ 869.490579] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 in Status: SUCCESS [ 869.491424] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.493433] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b6467c7-f124-4efd-a762-76ed86421331 in Status: SUCCESS [ 869.496021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b6467c7-f124-4efd-a762-76ed86421331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.496021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.496021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.496021] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.496021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.496021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.496021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.496021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.496021] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92a0a3db-a366-45d6-b0b8-a9a2b4be13d4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.496021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b6467c7-f124-4efd-a762-76ed86421331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.496021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b6467c7-f124-4efd-a762-76ed86421331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.496792] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.496792] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.496792] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.496792] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.496792] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.496792] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b6467c7-f124-4efd-a762-76ed86421331',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.499081] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.499224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.499291] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.500113] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.500113] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.543405] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 in Status: IN_PROGRESS for 2s [ 869.562129] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.562129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.562129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.562129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.562129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.583018] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cfd4659-cc60-4e40-83b3-09f036d8f58c in Status: SUCCESS [ 869.583018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cfd4659-cc60-4e40-83b3-09f036d8f58c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.583463] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f07f408b-d949-4e30-bfe4-08c3628f17de in Status: UNINITIALIZED for 2s [ 869.600523] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.601591] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.602037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.602285] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.602376] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.602483] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58197438-6dcb-404e-a8c1-aeacc2454958 is going to be updated. [ 869.605993] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.605993] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.605993] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.605993] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.605993] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.605993] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 is going to be updated. [ 869.657880] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.658074] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.658310] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.658471] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.658619] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.675275] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: IN_PROGRESS for 2s [ 869.685455] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.685455] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.685455] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.685455] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.685455] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.694162] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58197438-6dcb-404e-a8c1-aeacc2454958 in Status: IN_PROGRESS for 2s [ 869.878112] env[70520]: INFO networking_nsxv3.common.synchronization [req-18a98f54-20f6-4250-b880-1b63e8b67b2a req-862f1249-fe82-46e6-af92-a9285160939f tempest-ServerDiskConfigTestJSON-984450191 tempest-ServerDiskConfigTestJSON-984450191-project-member] Enqueued Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 869.878700] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 869.879531] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.879691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.879779] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.880017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.880187] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.880363] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.880363] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.880504] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.880592] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.880681] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.998631] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92a0a3db-a366-45d6-b0b8-a9a2b4be13d4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.004184] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.004184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.004184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.004184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.004184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.004184] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.004184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.004184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.004184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.004184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.004184] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b6467c7-f124-4efd-a762-76ed86421331 is going to be deleted. [ 870.091069] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.091233] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.091289] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.091498] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.091589] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.091690] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b6467c7-f124-4efd-a762-76ed86421331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.091847] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b6467c7-f124-4efd-a762-76ed86421331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.092012] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b6467c7-f124-4efd-a762-76ed86421331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.092178] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.093180] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.093180] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.093180] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.093180] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.093180] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b6467c7-f124-4efd-a762-76ed86421331',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.385147] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.385147] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.385147] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.385147] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.385147] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.385352] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.385472] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.385472] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.386164] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.386164] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.386164] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 is going to be updated. [ 870.419992] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.420248] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.420316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.420474] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.420619] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.435601] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: IN_PROGRESS for 2s [ 870.501109] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92a0a3db-a366-45d6-b0b8-a9a2b4be13d4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.564255] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-265 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.568334] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-265" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.568334] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-265" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.568334] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-265" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.568334] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.568334] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.568627] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.568627] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.568742] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.568955] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 870.569203] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 870.569203] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 870.569339] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 870.569384] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 870.569491] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 870.569620] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 870.595429] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.595690] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.595690] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.595924] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.595924] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.596994] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.597206] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.597206] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.597394] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.597479] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.597570] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b6467c7-f124-4efd-a762-76ed86421331 already deleted. [ 870.597656] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b6467c7-f124-4efd-a762-76ed86421331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.597747] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b6467c7-f124-4efd-a762-76ed86421331',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.598921] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b6467c7-f124-4efd-a762-76ed86421331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.599117] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b6467c7-f124-4efd-a762-76ed86421331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.599279] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.599373] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.599433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.599582] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.599659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.599747] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b6467c7-f124-4efd-a762-76ed86421331',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.614282] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 870.614715] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.045 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 870.614715] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 870.614833] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-265" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.615115] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-350bcb9f-f36a-4128-abd4-d0e7c42b5e02 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.615320] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-350bcb9f-f36a-4128-abd4-d0e7c42b5e02" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.615956] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-350bcb9f-f36a-4128-abd4-d0e7c42b5e02" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.615956] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-350bcb9f-f36a-4128-abd4-d0e7c42b5e02" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.616395] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('350bcb9f-f36a-4128-abd4-d0e7c42b5e02',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.004952] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.005180] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.005260] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.005428] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.005522] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.005628] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 is going to be updated. [ 871.036738] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.037227] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.037227] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.037723] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.037723] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.048830] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 in Status: IN_PROGRESS for 2s [ 871.102593] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b6467c7-f124-4efd-a762-76ed86421331',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.106841] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.107119] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.107243] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.107612] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.107687] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.107970] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.108260] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.108332] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.108518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.108685] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.108804] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b6467c7-f124-4efd-a762-76ed86421331 already deleted. [ 871.108965] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b6467c7-f124-4efd-a762-76ed86421331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.119547] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.120263] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.120263] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.121136] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.121425] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.121648] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 350bcb9f-f36a-4128-abd4-d0e7c42b5e02 not found, creating... [ 871.122146] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.122485] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.122811] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.123179] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.123373] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.123960] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.124228] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.124435] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.125335] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.125609] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.126141] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 350bcb9f-f36a-4128-abd4-d0e7c42b5e02 is going to be created. [ 871.154715] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.155633] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.155633] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.155633] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.155633] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.155926] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-350bcb9f-f36a-4128-abd4-d0e7c42b5e02" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.556206] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 in Status: SUCCESS [ 871.556206] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.596275] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f07f408b-d949-4e30-bfe4-08c3628f17de in Status: SUCCESS [ 871.596486] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.596542] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.596752] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.596964] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.597127] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.597191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.597351] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.597429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.598332] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.598332] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f07f408b-d949-4e30-bfe4-08c3628f17de',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.606139] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b6467c7-f124-4efd-a762-76ed86421331: rpc.has_security_group_logging(os_id): False [ 871.628703] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.629151] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.629151] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.629151] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.629310] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.629896] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.629896] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.629896] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.629896] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.629896] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.630183] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b6467c7-f124-4efd-a762-76ed86421331 is going to be created. [ 871.651355] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/8b6467c7-f124-4efd-a762-76ed86421331], does not exist path=[/infra/domains/default/groups/8b6467c7-f124-4efd-a762-76ed86421331]."\n}' [ 871.651594] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b6467c7-f124-4efd-a762-76ed86421331 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/8b6467c7-f124-4efd-a762-76ed86421331 [ 871.651674] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 871.684897] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: SUCCESS [ 871.685187] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.685364] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.685582] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.685774] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.685937] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.686059] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.687093] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.687093] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.687093] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.687093] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.687093] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.687093] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.687093] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.687093] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.687093] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.687093] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.687471] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.687471] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.687471] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.687552] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.696399] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.696399] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.696399] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.696399] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.696857] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.697318] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.697441] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.698029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.698029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.698029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.698029] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.698029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.698308] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.698308] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.698308] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.698386] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b6467c7-f124-4efd-a762-76ed86421331 is going to be created. [ 871.712058] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58197438-6dcb-404e-a8c1-aeacc2454958 in Status: SUCCESS [ 871.712523] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.714800] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.714800] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.714800] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.714800] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.714800] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.714800] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.714800] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.714800] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.714800] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58197438-6dcb-404e-a8c1-aeacc2454958',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.722450] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/8b6467c7-f124-4efd-a762-76ed86421331], does not exist path=[/infra/domains/default/groups/8b6467c7-f124-4efd-a762-76ed86421331]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/8b6467c7-f124-4efd-a762-76ed86421331 [ 871.722450] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b6467c7-f124-4efd-a762-76ed86421331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.722450] env[70520]: Traceback (most recent call last): [ 871.722450] env[70520]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 871.722450] env[70520]: return func(*args, **kwargs) [ 871.722450] env[70520]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 871.722450] env[70520]: res.raise_for_status() [ 871.722450] env[70520]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 871.722450] env[70520]: raise HTTPError(http_error_msg, response=self) [ 871.722450] env[70520]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/8b6467c7-f124-4efd-a762-76ed86421331 [ 871.722450] env[70520]: During handling of the above exception, another exception occurred: [ 871.722450] env[70520]: Traceback (most recent call last): [ 871.722450] env[70520]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 871.722450] env[70520]: listener.cb(fileno) [ 871.722450] env[70520]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 871.722450] env[70520]: result = function(*args, **kwargs) [ 871.722450] env[70520]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 871.722450] env[70520]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 871.722450] env[70520]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 871.722450] env[70520]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 871.722450] env[70520]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 871.722450] env[70520]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 871.722450] env[70520]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 871.722450] env[70520]: res.raise_for_status() [ 871.722450] env[70520]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 871.722450] env[70520]: raise HTTPError(http_error_msg, response=self) [ 871.722450] env[70520]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/8b6467c7-f124-4efd-a762-76ed86421331 [ 871.722450] env[70520]: Removing descriptor: 23 [ 872.104161] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f07f408b-d949-4e30-bfe4-08c3628f17de taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.104382] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.104454] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.104842] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.104908] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.104987] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.105050] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.105324] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.105324] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.105440] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.105527] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f07f408b-d949-4e30-bfe4-08c3628f17de taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.105659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.105710] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.105894] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.106080] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.106173] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.106260] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.106429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.106534] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.106682] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.106747] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f07f408b-d949-4e30-bfe4-08c3628f17de',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.191449] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b22ab11-3a43-4e3c-a9ac-8ee49b487341: rpc.has_security_group_logging(os_id): False [ 872.210727] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.210994] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.210994] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.211172] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.219842] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58197438-6dcb-404e-a8c1-aeacc2454958',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.235968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.236608] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.236884] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.236997] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.237219] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.240621] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.240621] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.240621] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.240621] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.240621] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.240621] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.240621] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.240621] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.240621] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.240621] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.240621] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.240621] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 is going to be updated. [ 872.302240] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.302506] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.302625] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.302930] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.303101] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.321906] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: IN_PROGRESS for 2s [ 872.434872] env[70520]: INFO networking_nsxv3.common.synchronization [req-18a98f54-20f6-4250-b880-1b63e8b67b2a req-6a68eb0d-c7d8-4c0b-8bab-9662f3bcfecf service nova] Enqueued Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_rules [ 872.441507] env[70520]: INFO networking_nsxv3.common.synchronization [req-18a98f54-20f6-4250-b880-1b63e8b67b2a req-6a68eb0d-c7d8-4c0b-8bab-9662f3bcfecf service nova] Enqueued Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 872.441722] env[70520]: INFO networking_nsxv3.common.synchronization [req-18a98f54-20f6-4250-b880-1b63e8b67b2a req-6a68eb0d-c7d8-4c0b-8bab-9662f3bcfecf service nova] Enqueued Resource ID: 350bcb9f-f36a-4128-abd4-d0e7c42b5e02 with Priority: HIGHEST for action port [ 872.442468] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_rules [ 872.442786] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 872.442786] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 350bcb9f-f36a-4128-abd4-d0e7c42b5e02 with Priority: HIGHEST for action port [ 872.444243] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.446370] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.446370] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.446370] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.446370] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.446370] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.446370] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.446370] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-350bcb9f-f36a-4128-abd4-d0e7c42b5e02 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.446370] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-350bcb9f-f36a-4128-abd4-d0e7c42b5e02" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.446370] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-350bcb9f-f36a-4128-abd4-d0e7c42b5e02" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.446370] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-350bcb9f-f36a-4128-abd4-d0e7c42b5e02" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.446370] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('350bcb9f-f36a-4128-abd4-d0e7c42b5e02',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.456843] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: SUCCESS [ 872.457330] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 deletion is rescheduled due to dependency. [ 872.457330] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.461784] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.461784] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.461784] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.461784] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.461784] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.461784] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.461784] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.461784] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.610067] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f07f408b-d949-4e30-bfe4-08c3628f17de: rpc.has_security_group_logging(os_id): False [ 872.632630] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.633301] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.633301] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.633301] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.633301] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.633457] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.633581] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.633642] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.633919] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.634196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.634196] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.634427] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.634427] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.634519] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.634624] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.634821] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.635013] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.635013] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.635385] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.635616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.635658] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f07f408b-d949-4e30-bfe4-08c3628f17de is going to be created. [ 872.713591] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.713746] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.713921] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.714044] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.714228] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.725036] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58197438-6dcb-404e-a8c1-aeacc2454958: rpc.has_security_group_logging(os_id): False [ 872.728153] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f07f408b-d949-4e30-bfe4-08c3628f17de in Status: IN_PROGRESS for 2s [ 872.749027] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.749027] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.749027] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.749027] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.752129] env[70520]: INFO networking_nsxv3.common.synchronization [None req-5029d227-bab4-4770-880d-6d8e3c8e19f7 None None] Enqueued Resource ID: d214c1cd-39b8-4724-8211-8450e3d436d5 with Priority: HIGHEST for action port [ 872.753996] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d214c1cd-39b8-4724-8211-8450e3d436d5 with Priority: HIGHEST for action port [ 872.753996] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-d214c1cd-39b8-4724-8211-8450e3d436d5 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.753996] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d214c1cd-39b8-4724-8211-8450e3d436d5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.753996] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d214c1cd-39b8-4724-8211-8450e3d436d5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.753996] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d214c1cd-39b8-4724-8211-8450e3d436d5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.753996] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d214c1cd-39b8-4724-8211-8450e3d436d5',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.778745] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.778972] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.779139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.779221] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.779462] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.779657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.779760] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58197438-6dcb-404e-a8c1-aeacc2454958 is going to be updated. [ 872.874392] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.874633] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.874702] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.874884] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.875094] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.892284] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58197438-6dcb-404e-a8c1-aeacc2454958 in Status: IN_PROGRESS for 2s [ 872.954186] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.954186] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.954186] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 350bcb9f-f36a-4128-abd4-d0e7c42b5e02 with status ACTIVE [ 872.954186] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.954186] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.954186] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.954186] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.954186] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.954186] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.954186] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.954186] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.954186] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.954186] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.954186] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.954952] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.954952] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.954952] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.957963] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.958028] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 350bcb9f-f36a-4128-abd4-d0e7c42b5e02 is going to be updated. [ 872.967726] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.984287] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.984287] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.984287] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.984287] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.984287] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.984287] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-350bcb9f-f36a-4128-abd4-d0e7c42b5e02" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.061541] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 in Status: SUCCESS [ 873.062374] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.062643] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.063039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.063359] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.063677] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.063677] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.063962] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.064572] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.064787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.064954] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('92a0a3db-a366-45d6-b0b8-a9a2b4be13d4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.066284] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.066526] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.067069] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.067348] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.067461] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.067834] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.068017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.068170] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92a0a3db-a366-45d6-b0b8-a9a2b4be13d4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.259459] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d214c1cd-39b8-4724-8211-8450e3d436d5 [ 873.259459] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.259459] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.259459] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.259459] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.259459] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.259459] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d214c1cd-39b8-4724-8211-8450e3d436d5 already deleted. [ 873.259459] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d214c1cd-39b8-4724-8211-8450e3d436d5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.467968] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.570509] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.570784] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.571936] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92a0a3db-a366-45d6-b0b8-a9a2b4be13d4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.972574] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.974018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.974018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.974018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.974018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.974018] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 is going to be updated. [ 874.006284] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.006284] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.006284] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.006284] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.006284] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.015468] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: IN_PROGRESS for 2s [ 874.040745] env[70520]: INFO networking_nsxv3.common.synchronization [req-4a013091-d46e-4ad2-95fd-6bf739a5309d req-33ca476a-bc9d-4297-a018-b06ce2acdb11 tempest-ServersNegativeTestJSON-641348566 tempest-ServersNegativeTestJSON-641348566-project-member] Enqueued Resource ID: d202bbfa-42d6-4633-985f-b1007599bbf2 with Priority: HIGHEST for action security_group_members [ 874.043159] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d202bbfa-42d6-4633-985f-b1007599bbf2 with Priority: HIGHEST for action security_group_members [ 874.043301] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d202bbfa-42d6-4633-985f-b1007599bbf2 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.043398] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.043398] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.044280] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.044280] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.044280] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.044280] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.044280] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.044280] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.044280] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d202bbfa-42d6-4633-985f-b1007599bbf2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.074589] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92a0a3db-a366-45d6-b0b8-a9a2b4be13d4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.338212] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: SUCCESS [ 874.338393] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.338571] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.338794] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.339186] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.547151] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d202bbfa-42d6-4633-985f-b1007599bbf2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.577190] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.577190] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.577657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.577657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.577657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.577657] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 is going to be updated. [ 874.598930] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-28 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.599155] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-28" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.599393] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-28" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.600023] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-28" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.600023] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.600023] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.600552] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.600832] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.600981] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.601214] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 874.601323] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 874.601465] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 874.601539] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 874.601631] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 874.601733] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 874.601991] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 874.627837] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.627837] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.627837] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.627837] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.627837] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.627837] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 874.628235] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 874.628235] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 874.628235] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-28" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.628553] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-055c3a08-a431-4475-b9d1-6880bac82c87 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.628708] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-055c3a08-a431-4475-b9d1-6880bac82c87" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.628799] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-055c3a08-a431-4475-b9d1-6880bac82c87" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.629140] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-055c3a08-a431-4475-b9d1-6880bac82c87" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.629268] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('055c3a08-a431-4475-b9d1-6880bac82c87',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.643591] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 in Status: IN_PROGRESS for 2s [ 874.745403] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f07f408b-d949-4e30-bfe4-08c3628f17de in Status: SUCCESS [ 874.745939] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.842086] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.842491] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.842491] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.843162] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.843407] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.843541] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.843611] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.843934] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.844048] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.844109] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.844177] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.908063] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58197438-6dcb-404e-a8c1-aeacc2454958 in Status: SUCCESS [ 874.908454] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.046814] env[70520]: INFO networking_nsxv3.common.synchronization [None req-74330dd7-acc8-44ef-a4e9-fbdd05dc09bd None None] Enqueued Resource ID: 078565c1-9608-4400-8b89-35c46a3d7040 with Priority: HIGHEST for action port [ 875.047402] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078565c1-9608-4400-8b89-35c46a3d7040 with Priority: HIGHEST for action port [ 875.047690] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-078565c1-9608-4400-8b89-35c46a3d7040 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.048214] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-078565c1-9608-4400-8b89-35c46a3d7040" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.048214] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-078565c1-9608-4400-8b89-35c46a3d7040" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.048733] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-078565c1-9608-4400-8b89-35c46a3d7040" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.048842] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('078565c1-9608-4400-8b89-35c46a3d7040',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.049923] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d202bbfa-42d6-4633-985f-b1007599bbf2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.133858] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.134201] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.134337] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.134629] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.134778] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.134965] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 055c3a08-a431-4475-b9d1-6880bac82c87 not found, creating... [ 875.135740] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.137779] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.137941] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.138257] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.138413] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.138737] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.138902] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.140624] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.142735] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.142939] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.143122] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 055c3a08-a431-4475-b9d1-6880bac82c87 is going to be created. [ 875.164922] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.165171] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.165296] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.165606] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.165840] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.166137] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-055c3a08-a431-4475-b9d1-6880bac82c87" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.350139] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.350139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.350139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.350139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.350139] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.350139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.350139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.350139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.350139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.350139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.350139] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.350139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.350139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.350139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.350139] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.351041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.351041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.351041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.351041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.351041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.351041] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.556242] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.556242] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.556242] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.556242] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.556242] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.556242] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d202bbfa-42d6-4633-985f-b1007599bbf2 is going to be updated. [ 875.556586] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 078565c1-9608-4400-8b89-35c46a3d7040 [ 875.556733] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.556843] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.556921] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.557160] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.557245] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.557341] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:078565c1-9608-4400-8b89-35c46a3d7040 already deleted. [ 875.557421] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-078565c1-9608-4400-8b89-35c46a3d7040" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.595358] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.595551] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.595617] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.595934] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.596103] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.615574] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d202bbfa-42d6-4633-985f-b1007599bbf2 in Status: IN_PROGRESS for 2s [ 875.853047] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b22ab11-3a43-4e3c-a9ac-8ee49b487341: rpc.has_security_group_logging(os_id): False [ 875.874168] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.875851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.875851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.875851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.875851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.875851] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.875851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.875851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.875851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.875851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.875851] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.875851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.875851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.876605] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.876605] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.876666] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.879037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.879037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.879037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.879037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.879037] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 is going to be updated. [ 875.941105] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.941385] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.941385] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.941556] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.941703] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.956666] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: IN_PROGRESS for 2s [ 875.998631] env[70520]: INFO networking_nsxv3.common.synchronization [req-4a013091-d46e-4ad2-95fd-6bf739a5309d req-f8b97e4a-e60b-4b26-b062-0d9d55b8878b service nova] Enqueued Resource ID: d202bbfa-42d6-4633-985f-b1007599bbf2 with Priority: HIGHEST for action security_group_rules [ 875.998804] env[70520]: INFO networking_nsxv3.common.synchronization [req-4a013091-d46e-4ad2-95fd-6bf739a5309d req-f8b97e4a-e60b-4b26-b062-0d9d55b8878b service nova] Enqueued Resource ID: d202bbfa-42d6-4633-985f-b1007599bbf2 with Priority: HIGHEST for action security_group_members [ 875.998947] env[70520]: INFO networking_nsxv3.common.synchronization [req-4a013091-d46e-4ad2-95fd-6bf739a5309d req-f8b97e4a-e60b-4b26-b062-0d9d55b8878b service nova] Enqueued Resource ID: 055c3a08-a431-4475-b9d1-6880bac82c87 with Priority: HIGHEST for action port [ 875.999980] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d202bbfa-42d6-4633-985f-b1007599bbf2 with Priority: HIGHEST for action security_group_rules [ 876.000247] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d202bbfa-42d6-4633-985f-b1007599bbf2 with Priority: HIGHEST for action security_group_members [ 876.000374] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 055c3a08-a431-4475-b9d1-6880bac82c87 with Priority: HIGHEST for action port [ 876.000737] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d202bbfa-42d6-4633-985f-b1007599bbf2 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.000828] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.000876] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.001130] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.001196] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d202bbfa-42d6-4633-985f-b1007599bbf2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.002457] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d202bbfa-42d6-4633-985f-b1007599bbf2 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.002588] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.002823] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-055c3a08-a431-4475-b9d1-6880bac82c87 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.002968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-055c3a08-a431-4475-b9d1-6880bac82c87" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.003497] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-055c3a08-a431-4475-b9d1-6880bac82c87" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.003706] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-055c3a08-a431-4475-b9d1-6880bac82c87" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.003793] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('055c3a08-a431-4475-b9d1-6880bac82c87',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.036141] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: SUCCESS [ 876.036399] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.037414] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.037716] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.039095] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.039287] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.039340] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.039591] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.039700] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.039777] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.039877] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.509024] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d202bbfa-42d6-4633-985f-b1007599bbf2 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.509024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.509024] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 055c3a08-a431-4475-b9d1-6880bac82c87 with status ACTIVE [ 876.509024] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.509024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.509024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.509024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.509024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.509024] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.509024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.509024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.509024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.509024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.509024] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.509834] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.509834] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.509834] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.509834] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.509834] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 055c3a08-a431-4475-b9d1-6880bac82c87 is going to be updated. [ 876.535858] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.536084] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.536142] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.536356] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.536517] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.536668] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-055c3a08-a431-4475-b9d1-6880bac82c87" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.542207] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.542379] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.542452] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.542665] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.542832] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.542942] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.543018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.543181] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.543266] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.543349] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.543510] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.543601] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.543673] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.543813] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.543990] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.544119] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.544244] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.544362] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.544484] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.544588] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.544692] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.657034] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 in Status: SUCCESS [ 876.657300] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.657471] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.657804] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.658118] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.658278] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.658380] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.658542] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.658623] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.658736] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92a0a3db-a366-45d6-b0b8-a9a2b4be13d4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.051243] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a23aa860-12db-4b07-ac46-cf4709db7164: rpc.has_security_group_logging(os_id): False [ 877.075036] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.075036] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.075036] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.075036] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.105277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.105277] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.105277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.105277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.105277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.105277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.105277] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.105277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.105277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.106821] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.107992] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.108601] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.108601] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.108601] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.108769] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.108804] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.108899] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 is going to be updated. [ 877.163188] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92a0a3db-a366-45d6-b0b8-a9a2b4be13d4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.184469] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.184469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.184469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.184469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.184469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.200385] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: IN_PROGRESS for 2s [ 877.205758] env[70520]: INFO networking_nsxv3.common.synchronization [req-c86b176b-b6c0-4308-976b-48d8b2453052 req-c7e78ece-7674-40eb-8c1d-4b38d4cc8108 tempest-ServersTestManualDisk-1453882973 tempest-ServersTestManualDisk-1453882973-project-member] Enqueued Resource ID: 7c9dafc4-e7ff-4514-ba35-e91b76e57256 with Priority: HIGHEST for action security_group_members [ 877.209033] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c9dafc4-e7ff-4514-ba35-e91b76e57256 with Priority: HIGHEST for action security_group_members [ 877.209033] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c9dafc4-e7ff-4514-ba35-e91b76e57256 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.209033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c9dafc4-e7ff-4514-ba35-e91b76e57256" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.209033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c9dafc4-e7ff-4514-ba35-e91b76e57256" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.209033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c9dafc4-e7ff-4514-ba35-e91b76e57256" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.209033] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.209033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.209033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.209033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.209033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.209033] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c9dafc4-e7ff-4514-ba35-e91b76e57256',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.628056] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d202bbfa-42d6-4633-985f-b1007599bbf2 in Status: SUCCESS [ 877.628425] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.628467] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.628662] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.628850] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.628970] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.629048] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.629202] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.629284] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.629381] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d202bbfa-42d6-4633-985f-b1007599bbf2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.666462] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92a0a3db-a366-45d6-b0b8-a9a2b4be13d4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.710987] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.711435] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.711502] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.711953] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.712026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.712293] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.712293] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.712392] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.712688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.712688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.712948] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c9dafc4-e7ff-4514-ba35-e91b76e57256 already deleted. [ 877.713061] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c9dafc4-e7ff-4514-ba35-e91b76e57256" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.805306] env[70520]: INFO networking_nsxv3.common.synchronization [None req-b3800826-e475-4479-abe5-a449cd4e891e None None] Enqueued Resource ID: f6d3af10-753a-44c9-959f-fc5b81496e51 with Priority: HIGHEST for action port [ 877.805306] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6d3af10-753a-44c9-959f-fc5b81496e51 with Priority: HIGHEST for action port [ 877.805306] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6d3af10-753a-44c9-959f-fc5b81496e51 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.805306] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6d3af10-753a-44c9-959f-fc5b81496e51" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.805306] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6d3af10-753a-44c9-959f-fc5b81496e51" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.805306] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6d3af10-753a-44c9-959f-fc5b81496e51" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.805306] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6d3af10-753a-44c9-959f-fc5b81496e51',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.972514] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: SUCCESS [ 877.972514] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.056490] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-428 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.056781] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-428" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.056961] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-428" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.057310] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-428" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.057577] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.057736] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.057873] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.062171] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.062389] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.062722] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 878.062722] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 878.064081] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 878.064081] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 878.064081] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 878.064081] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 878.064081] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 878.086696] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 878.087026] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 878.087270] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 878.087709] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-428" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.088794] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-fd1b032c-7ca8-471c-a404-ba768c828c4e taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.089635] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-fd1b032c-7ca8-471c-a404-ba768c828c4e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.090041] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-fd1b032c-7ca8-471c-a404-ba768c828c4e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.090347] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-fd1b032c-7ca8-471c-a404-ba768c828c4e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.090881] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd1b032c-7ca8-471c-a404-ba768c828c4e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.132601] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d202bbfa-42d6-4633-985f-b1007599bbf2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.169579] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.169747] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.169747] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.170178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.170178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.170178] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 is going to be updated. [ 878.212312] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.215093] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.215093] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.215093] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.215093] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.228656] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 in Status: IN_PROGRESS for 2s [ 878.315347] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f6d3af10-753a-44c9-959f-fc5b81496e51 [ 878.315347] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.315347] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.315347] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.315347] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.315347] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.315347] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f6d3af10-753a-44c9-959f-fc5b81496e51 already deleted. [ 878.315347] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6d3af10-753a-44c9-959f-fc5b81496e51" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.594839] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.595130] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.596117] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.596117] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.596234] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.596432] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port fd1b032c-7ca8-471c-a404-ba768c828c4e not found, creating... [ 878.596806] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.597038] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.599067] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.599385] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.599580] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.599979] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.600240] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.600240] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.600427] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.600596] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.600746] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: fd1b032c-7ca8-471c-a404-ba768c828c4e is going to be created. [ 878.633955] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d202bbfa-42d6-4633-985f-b1007599bbf2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.646856] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.647147] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.647238] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.647488] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.647723] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.648624] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-fd1b032c-7ca8-471c-a404-ba768c828c4e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.136579] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.139271] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.139271] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.139271] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.139271] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.139271] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d202bbfa-42d6-4633-985f-b1007599bbf2 is going to be updated. [ 879.185257] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.185257] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.185257] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.185257] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.185257] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.200026] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d202bbfa-42d6-4633-985f-b1007599bbf2 in Status: IN_PROGRESS for 2s [ 879.220590] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: SUCCESS [ 879.220590] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.521147] env[70520]: INFO networking_nsxv3.common.synchronization [req-c86b176b-b6c0-4308-976b-48d8b2453052 req-bc244b79-5146-4aa4-94d6-a197d66d7698 service nova] Enqueued Resource ID: 7c9dafc4-e7ff-4514-ba35-e91b76e57256 with Priority: HIGHEST for action security_group_rules [ 879.521147] env[70520]: INFO networking_nsxv3.common.synchronization [req-c86b176b-b6c0-4308-976b-48d8b2453052 req-bc244b79-5146-4aa4-94d6-a197d66d7698 service nova] Enqueued Resource ID: 7c9dafc4-e7ff-4514-ba35-e91b76e57256 with Priority: HIGHEST for action security_group_members [ 879.521147] env[70520]: INFO networking_nsxv3.common.synchronization [req-c86b176b-b6c0-4308-976b-48d8b2453052 req-bc244b79-5146-4aa4-94d6-a197d66d7698 service nova] Enqueued Resource ID: fd1b032c-7ca8-471c-a404-ba768c828c4e with Priority: HIGHEST for action port [ 879.521988] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c9dafc4-e7ff-4514-ba35-e91b76e57256 with Priority: HIGHEST for action security_group_rules [ 879.525017] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c9dafc4-e7ff-4514-ba35-e91b76e57256 with Priority: HIGHEST for action security_group_members [ 879.525017] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd1b032c-7ca8-471c-a404-ba768c828c4e with Priority: HIGHEST for action port [ 879.525017] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c9dafc4-e7ff-4514-ba35-e91b76e57256 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.525017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c9dafc4-e7ff-4514-ba35-e91b76e57256" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.525017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c9dafc4-e7ff-4514-ba35-e91b76e57256" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.525017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c9dafc4-e7ff-4514-ba35-e91b76e57256" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.525017] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c9dafc4-e7ff-4514-ba35-e91b76e57256',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.525017] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c9dafc4-e7ff-4514-ba35-e91b76e57256 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.525878] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c9dafc4-e7ff-4514-ba35-e91b76e57256" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.526589] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c9dafc4-e7ff-4514-ba35-e91b76e57256" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.529196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c9dafc4-e7ff-4514-ba35-e91b76e57256" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.529196] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.529196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.529196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.529196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.529196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.529196] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c9dafc4-e7ff-4514-ba35-e91b76e57256',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.531417] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd1b032c-7ca8-471c-a404-ba768c828c4e taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.531417] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd1b032c-7ca8-471c-a404-ba768c828c4e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.531417] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd1b032c-7ca8-471c-a404-ba768c828c4e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.531955] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd1b032c-7ca8-471c-a404-ba768c828c4e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.532730] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd1b032c-7ca8-471c-a404-ba768c828c4e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.032717] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c9dafc4-e7ff-4514-ba35-e91b76e57256',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.037021] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd1b032c-7ca8-471c-a404-ba768c828c4e with status ACTIVE [ 880.037021] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.037021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.037021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.037021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.037021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.037021] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.037021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.037021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.037021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.037021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.037021] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.037021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.037021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.037021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.037021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.037021] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd1b032c-7ca8-471c-a404-ba768c828c4e is going to be updated. [ 880.040497] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c9dafc4-e7ff-4514-ba35-e91b76e57256 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.041281] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c9dafc4-e7ff-4514-ba35-e91b76e57256" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.066663] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.066663] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.066663] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.066663] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.066663] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.066890] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd1b032c-7ca8-471c-a404-ba768c828c4e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.243020] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 in Status: SUCCESS [ 880.243020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.243020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.243020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.243020] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.243020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.243020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.243020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.243020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.243020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.243020] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.243020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.243020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.243020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.243020] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.243020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.243020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.243020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.243020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.244181] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.244436] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('92a0a3db-a366-45d6-b0b8-a9a2b4be13d4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.264017] env[70520]: INFO networking_nsxv3.common.synchronization [None req-bdb36791-1d70-46fb-985f-75d708abf8a2 None None] Enqueued Resource ID: 9d14dae1-525e-43e9-939b-da4707c71fa6 with Priority: HIGHEST for action port [ 880.264297] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d14dae1-525e-43e9-939b-da4707c71fa6 with Priority: HIGHEST for action port [ 880.265126] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d14dae1-525e-43e9-939b-da4707c71fa6 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.265126] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d14dae1-525e-43e9-939b-da4707c71fa6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.265126] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d14dae1-525e-43e9-939b-da4707c71fa6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.269395] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d14dae1-525e-43e9-939b-da4707c71fa6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.269500] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d14dae1-525e-43e9-939b-da4707c71fa6',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.400529] env[70520]: INFO networking_nsxv3.common.synchronization [None req-c6e6b6a6-670d-49c9-af32-45aef1b08a81 tempest-AttachInterfacesTestJSON-1687744298 tempest-AttachInterfacesTestJSON-1687744298-project-member] Enqueued Resource ID: 0775b802-20d8-4210-ad0d-b621a7b66c62 with Priority: HIGHEST for action security_group_rules [ 880.403168] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0775b802-20d8-4210-ad0d-b621a7b66c62 with Priority: HIGHEST for action security_group_rules [ 880.403493] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0775b802-20d8-4210-ad0d-b621a7b66c62 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.403703] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.403770] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.404566] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.404818] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0775b802-20d8-4210-ad0d-b621a7b66c62',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.536425] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c9dafc4-e7ff-4514-ba35-e91b76e57256',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.746942] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4: rpc.has_security_group_logging(os_id): False [ 880.770984] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.770984] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.770984] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.771266] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.773199] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d14dae1-525e-43e9-939b-da4707c71fa6 [ 880.773199] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.773199] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.773199] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.773199] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.773539] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.773794] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d14dae1-525e-43e9-939b-da4707c71fa6 already deleted. [ 880.773794] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d14dae1-525e-43e9-939b-da4707c71fa6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.801764] env[70520]: INFO networking_nsxv3.common.synchronization [None req-d04a2dca-6852-4a01-ac50-f990ca24f1a2 tempest-AttachInterfacesTestJSON-1687744298 tempest-AttachInterfacesTestJSON-1687744298-project-member] Enqueued Resource ID: 0775b802-20d8-4210-ad0d-b621a7b66c62 with Priority: HIGHEST for action security_group_rules [ 880.802883] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.806604] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.806897] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.806897] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.807104] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.807166] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.807383] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.807485] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.807547] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.807713] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.807801] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.807973] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.808092] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.808131] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.809107] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.809107] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.809107] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 is going to be updated. [ 880.809920] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0775b802-20d8-4210-ad0d-b621a7b66c62 with Priority: HIGHEST for action security_group_rules [ 880.811316] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0775b802-20d8-4210-ad0d-b621a7b66c62 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.811316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.862597] env[70520]: INFO networking_nsxv3.common.synchronization [req-8d11e784-9da5-4467-91d6-7700a073d685 req-ba647bcd-3a90-4c13-af12-bba318d90bfd tempest-FloatingIPsAssociationNegativeTestJSON-1182819157 tempest-FloatingIPsAssociationNegativeTestJSON-1182819157-project-member] Enqueued Resource ID: e541827f-5a38-4732-ac7b-f8cf25dc1ec1 with Priority: HIGHEST for action security_group_members [ 880.863443] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e541827f-5a38-4732-ac7b-f8cf25dc1ec1 with Priority: HIGHEST for action security_group_members [ 880.864252] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.864252] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.864252] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.864252] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.867295] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.867295] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.867394] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.867657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.867657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.867745] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e541827f-5a38-4732-ac7b-f8cf25dc1ec1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.891258] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.891528] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.891569] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.892180] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.892180] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.909135] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 in Status: IN_PROGRESS for 2s [ 880.934265] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.934443] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.934484] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.934855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.934951] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.935076] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0775b802-20d8-4210-ad0d-b621a7b66c62 already deleted. [ 880.935153] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.935773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.936062] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.936141] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0775b802-20d8-4210-ad0d-b621a7b66c62',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.040040] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.040040] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.040040] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.040040] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.040040] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.040040] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c9dafc4-e7ff-4514-ba35-e91b76e57256 is going to be created. [ 881.073623] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.073623] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.073855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.074634] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.074634] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.086858] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c9dafc4-e7ff-4514-ba35-e91b76e57256 in Status: UNINITIALIZED for 2s [ 881.145316] env[70520]: INFO networking_nsxv3.common.synchronization [req-db452531-36ef-4b34-81c1-7857ca2c53bf req-122faa0e-41ee-47f4-8104-dd541d90f96a tempest-ServerRescueTestJSONUnderV235-1054354334 tempest-ServerRescueTestJSONUnderV235-1054354334-project-member] Enqueued Resource ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 with Priority: HIGHEST for action security_group_members [ 881.145630] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 with Priority: HIGHEST for action security_group_members [ 881.146078] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.146220] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.146275] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.146557] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.146834] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.146960] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.147058] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.148253] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.148390] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.148573] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92a0a3db-a366-45d6-b0b8-a9a2b4be13d4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.213380] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d202bbfa-42d6-4633-985f-b1007599bbf2 in Status: SUCCESS [ 881.213945] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.217191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.217191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.217191] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.217191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.217191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.217191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.217191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.217191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.217191] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d202bbfa-42d6-4633-985f-b1007599bbf2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.370266] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.370483] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.371356] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.371625] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.395084] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.395340] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.395479] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.395575] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.395711] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.395797] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.395872] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e541827f-5a38-4732-ac7b-f8cf25dc1ec1 is going to be updated. [ 881.428244] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.428418] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.428488] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.428700] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.428833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.442060] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e541827f-5a38-4732-ac7b-f8cf25dc1ec1 in Status: IN_PROGRESS for 2s [ 881.458760] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.458760] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.458760] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.458760] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.458760] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.458760] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0775b802-20d8-4210-ad0d-b621a7b66c62 already deleted. [ 881.458760] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.655039] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.655039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.655039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.655039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.655039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.655039] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.655039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.655039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.655039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.655039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.655039] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 is going to be updated. [ 881.691315] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.691636] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.691851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.692191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.697080] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.706975] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 in Status: IN_PROGRESS for 2s [ 881.722109] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d202bbfa-42d6-4633-985f-b1007599bbf2 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.722481] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.722647] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.722978] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.723264] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.723472] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.723642] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.723876] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.724070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.724538] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.725962] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d202bbfa-42d6-4633-985f-b1007599bbf2 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.725962] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.725962] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.725962] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.725962] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.725962] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.725962] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.725962] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.725962] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.725962] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.725962] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d202bbfa-42d6-4633-985f-b1007599bbf2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.236875] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d202bbfa-42d6-4633-985f-b1007599bbf2: rpc.has_security_group_logging(os_id): False [ 882.257590] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.257843] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.257962] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.258253] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.285066] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.285066] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.285066] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.285066] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.285066] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.288606] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.288606] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.288606] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.288606] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.288606] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.288606] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.288606] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.288606] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.288606] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.288606] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.288606] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.290792] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d202bbfa-42d6-4633-985f-b1007599bbf2 is going to be updated. [ 882.362633] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.362892] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.362992] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.363480] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.363480] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.379784] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d202bbfa-42d6-4633-985f-b1007599bbf2 in Status: IN_PROGRESS for 2s [ 882.666908] env[70520]: INFO networking_nsxv3.common.synchronization [req-767d28a3-6ccc-4a7a-8b77-1005ecaadfff req-888fb9f0-5fc9-400d-b89c-c992efd1a644 tempest-DeleteServersTestJSON-1399047283 tempest-DeleteServersTestJSON-1399047283-project-member] Enqueued Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 882.666908] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 882.668665] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.670416] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.673038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.673038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.673038] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.673038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.673038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.673038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.673038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.673038] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.803131] env[70520]: INFO networking_nsxv3.common.synchronization [req-2263928f-ec4c-4bdd-95f5-9e7866b7817b req-1732ae80-93ad-412a-9dfb-875e59442bf6 tempest-ServersWithSpecificFlavorTestJSON-1288943951 tempest-ServersWithSpecificFlavorTestJSON-1288943951-project-member] Enqueued Resource ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee with Priority: HIGHEST for action security_group_members [ 882.803753] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee with Priority: HIGHEST for action security_group_members [ 882.804181] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-2449c3c4-f89c-449c-97e2-c22d5d72dbee taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.804307] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.804378] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.804700] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.804776] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.804925] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.805030] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.805216] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.805283] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.805335] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2449c3c4-f89c-449c-97e2-c22d5d72dbee',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.928765] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 in Status: SUCCESS [ 882.929030] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.929233] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.929556] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.929556] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92a0a3db-a366-45d6-b0b8-a9a2b4be13d4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.102092] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c9dafc4-e7ff-4514-ba35-e91b76e57256 in Status: SUCCESS [ 883.102437] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c9dafc4-e7ff-4514-ba35-e91b76e57256" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.103096] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c9dafc4-e7ff-4514-ba35-e91b76e57256" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.103190] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c9dafc4-e7ff-4514-ba35-e91b76e57256" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.103475] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.103658] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.104587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.104587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.104587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.104587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c9dafc4-e7ff-4514-ba35-e91b76e57256" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.104587] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c9dafc4-e7ff-4514-ba35-e91b76e57256',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.177801] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.177801] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.177801] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.177801] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.202026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.202026] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.202026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.207879] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.207879] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.207879] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.207879] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f is going to be updated. [ 883.243968] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.244259] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.244300] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.244487] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.248041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.259859] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: IN_PROGRESS for 2s [ 883.311261] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.311261] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.311261] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.311261] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.353262] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.353481] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.353594] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.353656] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.353872] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.353973] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.354082] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee is going to be updated. [ 883.414246] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.414895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.414895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.414895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.414895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.430022] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee in Status: IN_PROGRESS for 2s [ 883.452295] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e541827f-5a38-4732-ac7b-f8cf25dc1ec1 in Status: SUCCESS [ 883.452540] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e541827f-5a38-4732-ac7b-f8cf25dc1ec1 deletion is rescheduled due to dependency. [ 883.452603] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.464128] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.464128] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.464128] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.464128] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.464128] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.464128] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 is going to be deleted. [ 883.470702] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-405 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.470871] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-405" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.471634] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-405" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.472044] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-405" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.472495] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.472783] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.473412] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.473745] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.473898] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.474193] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 883.474310] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 883.474424] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 883.474529] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 883.475175] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 883.475438] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 883.475523] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 883.500307] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 883.500307] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 883.500989] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 883.500989] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-405" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.501236] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-fbf53343-6877-40c3-951a-20ff5038d515 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.501477] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-fbf53343-6877-40c3-951a-20ff5038d515" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.501891] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-fbf53343-6877-40c3-951a-20ff5038d515" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.502684] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-fbf53343-6877-40c3-951a-20ff5038d515" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.502684] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbf53343-6877-40c3-951a-20ff5038d515',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.543131] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.543536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.543536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.543725] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.543818] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.543939] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.608034] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c9dafc4-e7ff-4514-ba35-e91b76e57256',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.718095] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 in Status: SUCCESS [ 883.718317] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92a0a3db-a366-45d6-b0b8-a9a2b4be13d4 deletion is rescheduled due to dependency. [ 883.718448] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92a0a3db-a366-45d6-b0b8-a9a2b4be13d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.006684] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.006846] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.007025] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.007313] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.007482] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.007659] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port fbf53343-6877-40c3-951a-20ff5038d515 not found, creating... [ 884.007937] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.008118] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.008240] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.008493] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.008629] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.009451] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.009718] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.009886] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.010139] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.010273] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.010696] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: fbf53343-6877-40c3-951a-20ff5038d515 is going to be created. [ 884.036367] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.036849] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.036993] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.037337] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.037624] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.037874] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-fbf53343-6877-40c3-951a-20ff5038d515" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.111072] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c9dafc4-e7ff-4514-ba35-e91b76e57256: rpc.has_security_group_logging(os_id): False [ 884.150831] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.151558] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.151689] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.151999] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.152176] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.152504] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.152671] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.152774] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.152985] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.153155] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.153568] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c9dafc4-e7ff-4514-ba35-e91b76e57256 is going to be created. [ 884.267183] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.267573] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.267573] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.267915] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.268152] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.287268] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c9dafc4-e7ff-4514-ba35-e91b76e57256 in Status: IN_PROGRESS for 2s [ 884.395372] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d202bbfa-42d6-4633-985f-b1007599bbf2 in Status: SUCCESS [ 884.395786] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.656479] env[70520]: INFO networking_nsxv3.common.synchronization [req-c7aab040-f3b2-41c0-864c-485d77317d19 req-0ad220f2-963c-444c-8145-bbc3b2a7c041 tempest-VolumesAdminNegativeTest-725810316 tempest-VolumesAdminNegativeTest-725810316-project-member] Enqueued Resource ID: f07f408b-d949-4e30-bfe4-08c3628f17de with Priority: HIGHEST for action security_group_members [ 884.656928] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f07f408b-d949-4e30-bfe4-08c3628f17de with Priority: HIGHEST for action security_group_members [ 884.657955] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f07f408b-d949-4e30-bfe4-08c3628f17de taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.658113] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.658558] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.658558] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.658558] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.658741] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.658741] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.658886] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.658978] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.659097] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f07f408b-d949-4e30-bfe4-08c3628f17de',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.163084] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.163270] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.163317] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.163516] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.163600] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.163789] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.163893] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.163945] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.164134] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.164248] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.164334] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f07f408b-d949-4e30-bfe4-08c3628f17de is going to be updated. [ 885.200631] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.200983] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.200983] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.201193] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.201379] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.220262] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f07f408b-d949-4e30-bfe4-08c3628f17de in Status: IN_PROGRESS for 2s [ 885.272494] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: SUCCESS [ 885.275026] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f deletion is rescheduled due to dependency. [ 885.275026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.423719] env[70520]: INFO networking_nsxv3.common.synchronization [req-2263928f-ec4c-4bdd-95f5-9e7866b7817b req-b64392d9-8706-43c7-9456-67165fc60a88 service nova] Enqueued Resource ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee with Priority: HIGHEST for action security_group_rules [ 885.423897] env[70520]: INFO networking_nsxv3.common.synchronization [req-2263928f-ec4c-4bdd-95f5-9e7866b7817b req-b64392d9-8706-43c7-9456-67165fc60a88 service nova] Enqueued Resource ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee with Priority: HIGHEST for action security_group_members [ 885.424066] env[70520]: INFO networking_nsxv3.common.synchronization [req-2263928f-ec4c-4bdd-95f5-9e7866b7817b req-b64392d9-8706-43c7-9456-67165fc60a88 service nova] Enqueued Resource ID: fbf53343-6877-40c3-951a-20ff5038d515 with Priority: HIGHEST for action port [ 885.424301] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee with Priority: HIGHEST for action security_group_rules [ 885.424423] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee with Priority: HIGHEST for action security_group_members [ 885.424514] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf53343-6877-40c3-951a-20ff5038d515 with Priority: HIGHEST for action port [ 885.425571] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.425773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.425875] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.426147] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.426417] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2449c3c4-f89c-449c-97e2-c22d5d72dbee',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.427423] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-2449c3c4-f89c-449c-97e2-c22d5d72dbee taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.427568] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.427820] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbf53343-6877-40c3-951a-20ff5038d515 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.427993] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbf53343-6877-40c3-951a-20ff5038d515" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.428114] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbf53343-6877-40c3-951a-20ff5038d515" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.428339] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbf53343-6877-40c3-951a-20ff5038d515" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.428451] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbf53343-6877-40c3-951a-20ff5038d515',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.440657] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee in Status: SUCCESS [ 885.440864] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee deletion is rescheduled due to dependency. [ 885.440981] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.441172] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.441387] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.441671] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.441734] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.441768] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.441931] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.442033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.442124] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2449c3c4-f89c-449c-97e2-c22d5d72dbee',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.653719] env[70520]: INFO networking_nsxv3.common.synchronization [None req-633686fa-7e81-4d5b-80d7-456aae2c0940 None None] Enqueued Resource ID: cba07613-7d48-4255-9457-c11ec1adbea9 with Priority: HIGHEST for action port [ 885.655159] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cba07613-7d48-4255-9457-c11ec1adbea9 with Priority: HIGHEST for action port [ 885.655916] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-cba07613-7d48-4255-9457-c11ec1adbea9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.655916] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cba07613-7d48-4255-9457-c11ec1adbea9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.655916] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cba07613-7d48-4255-9457-c11ec1adbea9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.656250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cba07613-7d48-4255-9457-c11ec1adbea9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.656379] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cba07613-7d48-4255-9457-c11ec1adbea9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.681536] env[70520]: INFO networking_nsxv3.common.synchronization [req-a411ebad-f431-4185-849b-c536f0a85d73 req-b2e09265-7524-4fe1-8802-c73dc2038507 tempest-ServerActionsTestJSON-420425725 tempest-ServerActionsTestJSON-420425725-project-member] Enqueued Resource ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c with Priority: HIGHEST for action security_group_members [ 885.682646] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c with Priority: HIGHEST for action security_group_members [ 885.682990] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d999f7b-50c9-40ee-b3b1-31ead407224c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.683904] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.684335] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.684403] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.685021] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.685021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.685021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.685222] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.685552] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.685706] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d999f7b-50c9-40ee-b3b1-31ead407224c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.930458] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-2449c3c4-f89c-449c-97e2-c22d5d72dbee taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.933168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.933168] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fbf53343-6877-40c3-951a-20ff5038d515 with status ACTIVE [ 885.933168] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.933168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.933168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.933168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.933168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.933168] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.933168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.933168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.933168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.933168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.933168] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.933168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.933168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.933168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.940549] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.940549] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fbf53343-6877-40c3-951a-20ff5038d515 is going to be updated. [ 885.945249] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2449c3c4-f89c-449c-97e2-c22d5d72dbee',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.962514] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.962514] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.962733] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.962913] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.962990] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.963126] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbf53343-6877-40c3-951a-20ff5038d515" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.163468] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cba07613-7d48-4255-9457-c11ec1adbea9 [ 886.163686] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.163812] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.163877] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.164101] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.164241] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.164334] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cba07613-7d48-4255-9457-c11ec1adbea9 already deleted. [ 886.164414] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cba07613-7d48-4255-9457-c11ec1adbea9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.166928] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-135 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.167154] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-135" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.167297] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-135" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.167636] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-135" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.167975] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.168096] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.168196] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.168431] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.168565] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.168775] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 886.168886] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 886.169102] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 886.169102] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 886.169245] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 886.169363] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 886.169497] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 886.192037] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.192037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.192037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.192327] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.192327] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.192386] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.192540] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.192673] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.192826] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.192918] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.193017] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c already deleted. [ 886.193135] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.195161] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 886.195429] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 886.195511] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 886.196614] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-135" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.196614] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-1936c003-2b62-4ba0-b826-35044078faf9 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.196614] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-1936c003-2b62-4ba0-b826-35044078faf9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.196614] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-1936c003-2b62-4ba0-b826-35044078faf9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.196614] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-1936c003-2b62-4ba0-b826-35044078faf9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.196614] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1936c003-2b62-4ba0-b826-35044078faf9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.303708] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c9dafc4-e7ff-4514-ba35-e91b76e57256 in Status: SUCCESS [ 886.303708] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c9dafc4-e7ff-4514-ba35-e91b76e57256" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.450220] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2449c3c4-f89c-449c-97e2-c22d5d72dbee',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.703195] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.703195] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.703195] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.703195] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.703195] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.703622] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 1936c003-2b62-4ba0-b826-35044078faf9 not found, creating... [ 886.703622] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.703622] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.703812] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.703985] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.704090] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.704383] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.704666] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.704666] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.705371] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.705583] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.705731] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 1936c003-2b62-4ba0-b826-35044078faf9 is going to be created. [ 886.728872] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.729208] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.729424] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.729845] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.730233] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.734463] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-1936c003-2b62-4ba0-b826-35044078faf9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.951745] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.954842] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.954842] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.954842] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.954842] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.954842] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee is going to be updated. [ 886.992681] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.992847] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.992921] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.993168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.993313] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.003889] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee in Status: IN_PROGRESS for 2s [ 887.231186] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f07f408b-d949-4e30-bfe4-08c3628f17de in Status: SUCCESS [ 887.232141] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f07f408b-d949-4e30-bfe4-08c3628f17de deletion is rescheduled due to dependency. [ 887.232301] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.741645] env[70520]: INFO networking_nsxv3.common.synchronization [None req-51397749-25e8-487e-824f-5fa971c051bd None None] Enqueued Resource ID: 125626f5-8c8f-49ed-a006-93252f8b669e with Priority: HIGHEST for action port [ 887.743168] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 125626f5-8c8f-49ed-a006-93252f8b669e with Priority: HIGHEST for action port [ 887.743681] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-125626f5-8c8f-49ed-a006-93252f8b669e taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.743681] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-125626f5-8c8f-49ed-a006-93252f8b669e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.743857] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-125626f5-8c8f-49ed-a006-93252f8b669e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.745522] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-125626f5-8c8f-49ed-a006-93252f8b669e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.745522] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('125626f5-8c8f-49ed-a006-93252f8b669e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.936387] env[70520]: INFO networking_nsxv3.common.synchronization [req-a411ebad-f431-4185-849b-c536f0a85d73 req-54cddf5b-803f-4c1f-9fbf-3e5b02cd86c2 service nova] Enqueued Resource ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c with Priority: HIGHEST for action security_group_rules [ 887.940025] env[70520]: INFO networking_nsxv3.common.synchronization [req-a411ebad-f431-4185-849b-c536f0a85d73 req-54cddf5b-803f-4c1f-9fbf-3e5b02cd86c2 service nova] Enqueued Resource ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c with Priority: HIGHEST for action security_group_members [ 887.940025] env[70520]: INFO networking_nsxv3.common.synchronization [req-a411ebad-f431-4185-849b-c536f0a85d73 req-54cddf5b-803f-4c1f-9fbf-3e5b02cd86c2 service nova] Enqueued Resource ID: 1936c003-2b62-4ba0-b826-35044078faf9 with Priority: HIGHEST for action port [ 887.940603] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c with Priority: HIGHEST for action security_group_rules [ 887.940859] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c with Priority: HIGHEST for action security_group_members [ 887.941128] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1936c003-2b62-4ba0-b826-35044078faf9 with Priority: HIGHEST for action port [ 887.941816] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d999f7b-50c9-40ee-b3b1-31ead407224c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.942075] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.942241] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.944900] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.944900] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d999f7b-50c9-40ee-b3b1-31ead407224c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.944900] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d999f7b-50c9-40ee-b3b1-31ead407224c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.944900] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.944900] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.944900] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.944900] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.944900] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.944900] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.944900] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.944900] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.944900] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d999f7b-50c9-40ee-b3b1-31ead407224c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.953045] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-1936c003-2b62-4ba0-b826-35044078faf9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.953045] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1936c003-2b62-4ba0-b826-35044078faf9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.953045] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1936c003-2b62-4ba0-b826-35044078faf9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.953045] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1936c003-2b62-4ba0-b826-35044078faf9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.953045] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1936c003-2b62-4ba0-b826-35044078faf9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.979874] env[70520]: INFO networking_nsxv3.common.synchronization [None req-1c79dcde-e1a1-493e-8090-40505178d0b8 tempest-ServersV294TestFqdnHostnames-201987379 tempest-ServersV294TestFqdnHostnames-201987379-project-member] Enqueued Resource ID: 858fdcda-30cd-409f-85f7-656e8a82042b with Priority: HIGHEST for action security_group_rules [ 887.980219] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858fdcda-30cd-409f-85f7-656e8a82042b with Priority: HIGHEST for action security_group_rules [ 887.980544] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-858fdcda-30cd-409f-85f7-656e8a82042b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.980676] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.980743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.982689] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.982689] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('858fdcda-30cd-409f-85f7-656e8a82042b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.122881] env[70520]: INFO networking_nsxv3.common.synchronization [None req-b404082a-f127-441f-a787-efef456225e6 tempest-ServersV294TestFqdnHostnames-201987379 tempest-ServersV294TestFqdnHostnames-201987379-project-member] Enqueued Resource ID: 858fdcda-30cd-409f-85f7-656e8a82042b with Priority: HIGHEST for action security_group_rules [ 888.123734] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858fdcda-30cd-409f-85f7-656e8a82042b with Priority: HIGHEST for action security_group_rules [ 888.124219] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-858fdcda-30cd-409f-85f7-656e8a82042b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.124381] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.249873] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 125626f5-8c8f-49ed-a006-93252f8b669e [ 888.249873] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.249873] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.249873] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.249873] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.249873] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.249873] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:125626f5-8c8f-49ed-a006-93252f8b669e already deleted. [ 888.249873] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-125626f5-8c8f-49ed-a006-93252f8b669e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.453163] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d999f7b-50c9-40ee-b3b1-31ead407224c taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.453417] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.458129] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d999f7b-50c9-40ee-b3b1-31ead407224c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.458129] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1936c003-2b62-4ba0-b826-35044078faf9 with status ACTIVE [ 888.458129] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.458129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.458129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.458129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.458129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.458129] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.458129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.458129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.458129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.458129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.458129] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.458129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.458129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.460387] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.460387] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.460387] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1936c003-2b62-4ba0-b826-35044078faf9 is going to be updated. [ 888.487594] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.487827] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.487827] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.504316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.504316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.504316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1936c003-2b62-4ba0-b826-35044078faf9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.514365] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.514573] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.514573] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.516045] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.516045] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.516045] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 858fdcda-30cd-409f-85f7-656e8a82042b already deleted. [ 888.516045] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.516045] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.516045] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.516045] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('858fdcda-30cd-409f-85f7-656e8a82042b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.800293] env[70520]: INFO networking_nsxv3.common.synchronization [req-b3d211a3-a85c-4804-a23e-0e4d5ac41827 req-32293d1d-aa56-4196-8c40-d6b5d69a436b tempest-ServersAdminTestJSON-2063681355 tempest-ServersAdminTestJSON-2063681355-project-member] Enqueued Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_members [ 888.802136] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_members [ 888.802136] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.802136] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.802136] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.802478] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.802907] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.805209] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.805209] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.805209] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.805209] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.805209] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.956726] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d999f7b-50c9-40ee-b3b1-31ead407224c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.017978] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee in Status: SUCCESS [ 889.017978] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.019996] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.020176] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.020389] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.020544] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.020656] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.021463] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.021463] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.021463] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.021463] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2449c3c4-f89c-449c-97e2-c22d5d72dbee',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.042070] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.042070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.042070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.042070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.042677] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.042677] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 858fdcda-30cd-409f-85f7-656e8a82042b already deleted. [ 889.042677] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.097188] env[70520]: INFO networking_nsxv3.common.synchronization [None req-f3cdb8e1-cda4-4433-a8e4-57611061a97a None None] Enqueued Resource ID: d1ad5ee4-2749-455e-ba2e-4ae989fd8992 with Priority: HIGHEST for action port [ 889.097827] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1ad5ee4-2749-455e-ba2e-4ae989fd8992 with Priority: HIGHEST for action port [ 889.098693] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1ad5ee4-2749-455e-ba2e-4ae989fd8992 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.098693] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1ad5ee4-2749-455e-ba2e-4ae989fd8992" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.098693] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1ad5ee4-2749-455e-ba2e-4ae989fd8992" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.098693] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1ad5ee4-2749-455e-ba2e-4ae989fd8992" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.098693] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1ad5ee4-2749-455e-ba2e-4ae989fd8992',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.305937] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.459603] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.459603] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.459603] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.459603] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.459794] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.459794] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c is going to be created. [ 889.488086] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.488304] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.488416] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.488747] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.489027] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.500957] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c in Status: UNINITIALIZED for 2s [ 889.505397] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-318 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.505593] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-318" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.505714] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-318" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.506161] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-318" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.506331] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.506464] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.506600] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.506821] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.506981] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.507223] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 889.507351] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 889.507461] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 889.507567] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 889.507674] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 889.507777] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 889.507905] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 889.526396] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2449c3c4-f89c-449c-97e2-c22d5d72dbee',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.542320] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 889.542537] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 889.542678] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 889.542849] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-318" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.543234] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-878b8693-1e73-4d69-9932-361857e98a02 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.543377] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-878b8693-1e73-4d69-9932-361857e98a02" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.545888] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-878b8693-1e73-4d69-9932-361857e98a02" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.545888] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-878b8693-1e73-4d69-9932-361857e98a02" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.545888] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('878b8693-1e73-4d69-9932-361857e98a02',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.600981] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d1ad5ee4-2749-455e-ba2e-4ae989fd8992 [ 889.601343] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.601541] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.601685] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.601904] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.601991] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.602098] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d1ad5ee4-2749-455e-ba2e-4ae989fd8992 already deleted. [ 889.602180] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1ad5ee4-2749-455e-ba2e-4ae989fd8992" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.647927] env[70520]: INFO networking_nsxv3.common.synchronization [req-287325e7-408f-46d7-aa0c-90e2b93ff2b4 req-9e64f9f0-7f59-40f3-adda-e0c3a96ee866 tempest-ServersNegativeTestJSON-641348566 tempest-ServersNegativeTestJSON-641348566-project-member] Enqueued Resource ID: d202bbfa-42d6-4633-985f-b1007599bbf2 with Priority: HIGHEST for action security_group_members [ 889.648749] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d202bbfa-42d6-4633-985f-b1007599bbf2 with Priority: HIGHEST for action security_group_members [ 889.649978] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d202bbfa-42d6-4633-985f-b1007599bbf2 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.650212] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.650330] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.650794] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.651095] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.652120] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.652120] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.652120] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.652120] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.652120] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d202bbfa-42d6-4633-985f-b1007599bbf2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.808097] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.022023] env[70520]: INFO networking_nsxv3.common.synchronization [None req-a91a99e7-1465-43ca-b391-05b22eae902d None None] Enqueued Resource ID: 7a548cfd-0f33-4bc8-9c50-1a28ea13f786 with Priority: HIGHEST for action port [ 890.022023] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a548cfd-0f33-4bc8-9c50-1a28ea13f786 with Priority: HIGHEST for action port [ 890.022176] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a548cfd-0f33-4bc8-9c50-1a28ea13f786 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.022272] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a548cfd-0f33-4bc8-9c50-1a28ea13f786" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.022337] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a548cfd-0f33-4bc8-9c50-1a28ea13f786" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.022705] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a548cfd-0f33-4bc8-9c50-1a28ea13f786" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.022705] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a548cfd-0f33-4bc8-9c50-1a28ea13f786',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.028586] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2449c3c4-f89c-449c-97e2-c22d5d72dbee: rpc.has_security_group_logging(os_id): False [ 890.052807] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.052973] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.053134] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.053854] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.053854] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.054524] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.054524] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.054524] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.054683] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.054683] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.054739] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee is going to be updated. [ 890.057872] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.058011] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.058255] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.058320] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.058471] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.058603] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 878b8693-1e73-4d69-9932-361857e98a02 not found, creating... [ 890.058892] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.059096] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.059191] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.059406] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.059539] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.060166] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.060455] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.060570] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.060748] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.061257] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.061257] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 878b8693-1e73-4d69-9932-361857e98a02 is going to be created. [ 890.082785] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.083019] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.083296] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.084037] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.084037] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.084037] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-878b8693-1e73-4d69-9932-361857e98a02" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.140605] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.140804] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.140987] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.141329] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.141505] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.156418] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d202bbfa-42d6-4633-985f-b1007599bbf2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.170418] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee in Status: IN_PROGRESS for 2s [ 890.312308] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.312474] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.312539] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.312759] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.312843] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.312942] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 is going to be updated. [ 890.356869] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.357082] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.357214] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.357521] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.358763] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.381148] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: IN_PROGRESS for 2s [ 890.525999] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7a548cfd-0f33-4bc8-9c50-1a28ea13f786 [ 890.525999] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.525999] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.525999] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.525999] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.525999] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.526325] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7a548cfd-0f33-4bc8-9c50-1a28ea13f786 already deleted. [ 890.526325] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a548cfd-0f33-4bc8-9c50-1a28ea13f786" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.661916] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d202bbfa-42d6-4633-985f-b1007599bbf2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.165579] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.165905] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.165905] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.166126] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.166230] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.166645] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d202bbfa-42d6-4633-985f-b1007599bbf2 is going to be updated. [ 891.205851] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.206109] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.206233] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.206484] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.206651] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.220648] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d202bbfa-42d6-4633-985f-b1007599bbf2 in Status: IN_PROGRESS for 2s [ 891.492662] env[70520]: INFO networking_nsxv3.common.synchronization [req-b3d211a3-a85c-4804-a23e-0e4d5ac41827 req-8ea6406a-bb46-4b81-abd5-b7f2934ccd66 service nova] Enqueued Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_rules [ 891.492854] env[70520]: INFO networking_nsxv3.common.synchronization [req-b3d211a3-a85c-4804-a23e-0e4d5ac41827 req-8ea6406a-bb46-4b81-abd5-b7f2934ccd66 service nova] Enqueued Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_members [ 891.493022] env[70520]: INFO networking_nsxv3.common.synchronization [req-b3d211a3-a85c-4804-a23e-0e4d5ac41827 req-8ea6406a-bb46-4b81-abd5-b7f2934ccd66 service nova] Enqueued Resource ID: 878b8693-1e73-4d69-9932-361857e98a02 with Priority: HIGHEST for action port [ 891.493255] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_rules [ 891.493395] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_members [ 891.493485] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 878b8693-1e73-4d69-9932-361857e98a02 with Priority: HIGHEST for action port [ 891.494701] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4e36438-996a-4d8f-adfb-5a87b2e7bd82 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.494867] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.494930] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.495167] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.495246] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.497209] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.497405] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.497605] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-878b8693-1e73-4d69-9932-361857e98a02 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.497729] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-878b8693-1e73-4d69-9932-361857e98a02" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.497805] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-878b8693-1e73-4d69-9932-361857e98a02" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.498271] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-878b8693-1e73-4d69-9932-361857e98a02" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.498271] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('878b8693-1e73-4d69-9932-361857e98a02',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.515598] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c in Status: SUCCESS [ 891.515825] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.516423] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.516642] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.516831] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.516943] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.517012] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.517200] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.517275] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.517379] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.517470] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d999f7b-50c9-40ee-b3b1-31ead407224c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.002455] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.002455] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.002455] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 878b8693-1e73-4d69-9932-361857e98a02 with status ACTIVE [ 892.002455] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.005761] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.005761] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.005761] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.005761] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.005761] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.005761] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.005761] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.005761] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.005761] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.005761] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.005761] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.005761] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.005761] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.005761] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.005761] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 878b8693-1e73-4d69-9932-361857e98a02 is going to be updated. [ 892.011019] env[70520]: INFO networking_nsxv3.common.synchronization [None req-39fbc907-cc3a-4057-995d-485813ec5184 None None] Enqueued Resource ID: e22a7dc0-cbf3-4b54-8416-80965dcec169 with Priority: HIGHEST for action port [ 892.014195] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e22a7dc0-cbf3-4b54-8416-80965dcec169 with Priority: HIGHEST for action port [ 892.014195] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-e22a7dc0-cbf3-4b54-8416-80965dcec169 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.014195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e22a7dc0-cbf3-4b54-8416-80965dcec169" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.014195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e22a7dc0-cbf3-4b54-8416-80965dcec169" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.014195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e22a7dc0-cbf3-4b54-8416-80965dcec169" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.014195] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e22a7dc0-cbf3-4b54-8416-80965dcec169',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.020695] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d999f7b-50c9-40ee-b3b1-31ead407224c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.033718] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.034039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.034039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.034252] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.034382] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.034542] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-878b8693-1e73-4d69-9932-361857e98a02" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.185788] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee in Status: SUCCESS [ 892.187635] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.393316] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: SUCCESS [ 892.393316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.393316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.393316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.393316] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.393316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.393316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.393316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.393316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.393316] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.516233] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e22a7dc0-cbf3-4b54-8416-80965dcec169 [ 892.516482] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.516614] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.516679] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.516892] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.517013] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.517176] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e22a7dc0-cbf3-4b54-8416-80965dcec169 already deleted. [ 892.517271] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e22a7dc0-cbf3-4b54-8416-80965dcec169" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.524674] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d999f7b-50c9-40ee-b3b1-31ead407224c: rpc.has_security_group_logging(os_id): False [ 892.546525] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.546701] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.546746] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.546950] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.547061] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.547320] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.547441] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.547507] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.547660] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.547737] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.547823] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c is going to be created. [ 892.639009] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.639918] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.640079] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.640339] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.641042] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.659703] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c in Status: IN_PROGRESS for 2s [ 892.895705] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.230727] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d202bbfa-42d6-4633-985f-b1007599bbf2 in Status: SUCCESS [ 893.231067] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.399967] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.668832] env[70520]: INFO networking_nsxv3.common.synchronization [req-3aa339a7-05f2-4862-bfef-dd0c3bc8aee3 req-44fe0acc-6eb6-468c-9477-fc04e05de404 tempest-MultipleCreateTestJSON-1344547532 tempest-MultipleCreateTestJSON-1344547532-project-member] Enqueued Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_members [ 893.669896] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_members [ 893.669896] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.669896] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.670128] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.670361] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.670545] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.670690] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.670773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.670952] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.671087] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.671201] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.901948] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.902446] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.902446] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.902614] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.902702] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.903804] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 is going to be updated. [ 893.931864] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.932013] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.932096] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.932311] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.934837] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.942533] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: IN_PROGRESS for 2s [ 894.173425] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.173576] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.173621] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.173878] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.173918] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.174106] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.174206] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.174260] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.174570] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.174570] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.174570] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db already deleted. [ 894.174721] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.323266] env[70520]: INFO networking_nsxv3.common.synchronization [None req-b63e7458-e700-449b-9adf-964e46377431 None None] Enqueued Resource ID: 18f106de-838c-4609-a77f-072ccdb55c8c with Priority: HIGHEST for action port [ 894.323266] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18f106de-838c-4609-a77f-072ccdb55c8c with Priority: HIGHEST for action port [ 894.323266] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-18f106de-838c-4609-a77f-072ccdb55c8c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.323266] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18f106de-838c-4609-a77f-072ccdb55c8c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.323266] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18f106de-838c-4609-a77f-072ccdb55c8c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.323266] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18f106de-838c-4609-a77f-072ccdb55c8c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.323266] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18f106de-838c-4609-a77f-072ccdb55c8c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.361683] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-581 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.364464] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-581" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.364902] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-581" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.365010] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-581" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.365478] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.365587] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.365634] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.365990] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.366136] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.366453] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 894.366632] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 894.366768] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 894.367753] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 894.367753] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 894.367753] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 894.367753] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 894.390219] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 894.390405] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 894.390543] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 894.390717] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-581" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.391061] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-21552545-b78a-44da-a5aa-5999f51ac8ca taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.391238] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-21552545-b78a-44da-a5aa-5999f51ac8ca" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.391356] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-21552545-b78a-44da-a5aa-5999f51ac8ca" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.391682] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-21552545-b78a-44da-a5aa-5999f51ac8ca" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.391820] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21552545-b78a-44da-a5aa-5999f51ac8ca',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.678832] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c in Status: SUCCESS [ 894.679856] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.832363] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18f106de-838c-4609-a77f-072ccdb55c8c [ 894.832615] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.832752] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.832821] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.833066] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.833199] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.833305] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18f106de-838c-4609-a77f-072ccdb55c8c already deleted. [ 894.833427] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18f106de-838c-4609-a77f-072ccdb55c8c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.895469] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.895616] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.895708] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.895995] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.896241] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.896479] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 21552545-b78a-44da-a5aa-5999f51ac8ca not found, creating... [ 894.897042] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.897365] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.897564] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.897863] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.898472] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.898472] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.898472] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.898681] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.898791] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.898924] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.899081] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 21552545-b78a-44da-a5aa-5999f51ac8ca is going to be created. [ 894.923326] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.923582] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.923787] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.924234] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.924485] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.925020] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-21552545-b78a-44da-a5aa-5999f51ac8ca" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.690602] env[70520]: INFO networking_nsxv3.common.synchronization [req-3aa339a7-05f2-4862-bfef-dd0c3bc8aee3 req-8ba86854-46d5-4977-8c3e-e092b99302ee service nova] Enqueued Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_rules [ 895.690887] env[70520]: INFO networking_nsxv3.common.synchronization [req-3aa339a7-05f2-4862-bfef-dd0c3bc8aee3 req-8ba86854-46d5-4977-8c3e-e092b99302ee service nova] Enqueued Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_members [ 895.690951] env[70520]: INFO networking_nsxv3.common.synchronization [req-3aa339a7-05f2-4862-bfef-dd0c3bc8aee3 req-8ba86854-46d5-4977-8c3e-e092b99302ee service nova] Enqueued Resource ID: 21552545-b78a-44da-a5aa-5999f51ac8ca with Priority: HIGHEST for action port [ 895.691133] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_rules [ 895.691256] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_members [ 895.691347] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21552545-b78a-44da-a5aa-5999f51ac8ca with Priority: HIGHEST for action port [ 895.695402] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.696760] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.696760] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.696760] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.696760] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.700589] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.700589] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.700589] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.700968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.700968] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.700968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.701377] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.701377] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.701377] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.702556] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.704127] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-21552545-b78a-44da-a5aa-5999f51ac8ca taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.705405] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21552545-b78a-44da-a5aa-5999f51ac8ca" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.705405] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21552545-b78a-44da-a5aa-5999f51ac8ca" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.705405] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21552545-b78a-44da-a5aa-5999f51ac8ca" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.705405] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21552545-b78a-44da-a5aa-5999f51ac8ca',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.953215] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: SUCCESS [ 895.954114] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.954114] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.954114] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.954305] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.954305] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.954433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.954963] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.954963] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.954963] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.954963] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.207877] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.209302] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.209302] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.209302] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21552545-b78a-44da-a5aa-5999f51ac8ca with status ACTIVE [ 896.209302] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.209302] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.209688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.209688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.209688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.209833] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.209986] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.210680] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.212508] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.212636] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.212814] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.212922] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.212983] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.213167] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.213251] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.213341] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21552545-b78a-44da-a5aa-5999f51ac8ca is going to be updated. [ 896.239916] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.240132] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.240216] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.240461] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.240602] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.241343] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21552545-b78a-44da-a5aa-5999f51ac8ca" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.457710] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.457910] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.457990] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.458327] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.458614] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.458614] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.458614] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.458876] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.458876] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.458876] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.459047] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.459127] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.459127] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.459550] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.459550] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.459550] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.459550] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.459920] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.459920] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.459920] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.459920] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.552405] env[70520]: INFO networking_nsxv3.common.synchronization [req-3aa339a7-05f2-4862-bfef-dd0c3bc8aee3 req-56b35595-b2ad-4d4b-8f40-5e338cee7d7b tempest-MultipleCreateTestJSON-1344547532 tempest-MultipleCreateTestJSON-1344547532-project-member] Enqueued Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_members [ 896.553201] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_members [ 896.553300] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.553384] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.715281] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.962751] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4e36438-996a-4d8f-adfb-5a87b2e7bd82: rpc.has_security_group_logging(os_id): False [ 896.990372] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.990638] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.990864] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.991195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.021460] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.021772] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.021926] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.021993] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.024387] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.024387] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.024387] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.024387] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.024387] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.026129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.026129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.026129] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.026129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.026129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.026431] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.026537] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.026537] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 is going to be updated. [ 897.113028] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.113028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.113028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.113028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.113028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.143317] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: IN_PROGRESS for 2s [ 897.217954] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.218173] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.218227] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.218553] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.218649] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.218754] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db is going to be created. [ 897.238018] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-581 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.238310] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-581" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.238512] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-581" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.238826] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-581" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.239677] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.239855] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.239987] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.240259] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.240406] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.240617] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 897.240730] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 897.240851] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 897.240982] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 897.241151] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 897.241200] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 897.241411] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 897.273110] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.273110] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.273307] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.273420] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.273583] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.287516] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 897.287750] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.046 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 897.287929] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 897.288149] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-581" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.288493] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-067fee7b-ad4e-46d1-aecf-00957b3ffa7a taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.289407] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-067fee7b-ad4e-46d1-aecf-00957b3ffa7a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.289407] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-067fee7b-ad4e-46d1-aecf-00957b3ffa7a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.289407] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-067fee7b-ad4e-46d1-aecf-00957b3ffa7a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.289407] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('067fee7b-ad4e-46d1-aecf-00957b3ffa7a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.298274] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: UNINITIALIZED for 2s [ 897.792277] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.792614] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.792614] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.794135] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.794135] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.794135] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 067fee7b-ad4e-46d1-aecf-00957b3ffa7a not found, creating... [ 897.794135] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.794135] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.794135] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.794135] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.794528] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.794611] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.795718] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.795718] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.795718] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.795718] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.795718] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 067fee7b-ad4e-46d1-aecf-00957b3ffa7a is going to be created. [ 897.825211] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.825387] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.825430] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.825996] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.826222] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.826454] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-067fee7b-ad4e-46d1-aecf-00957b3ffa7a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.823536] env[70520]: INFO networking_nsxv3.common.synchronization [req-3aa339a7-05f2-4862-bfef-dd0c3bc8aee3 req-d60bdb90-18fa-4280-9a40-e083b4c76156 service nova] Enqueued Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_rules [ 898.823536] env[70520]: INFO networking_nsxv3.common.synchronization [req-3aa339a7-05f2-4862-bfef-dd0c3bc8aee3 req-d60bdb90-18fa-4280-9a40-e083b4c76156 service nova] Enqueued Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_members [ 898.823536] env[70520]: INFO networking_nsxv3.common.synchronization [req-3aa339a7-05f2-4862-bfef-dd0c3bc8aee3 req-d60bdb90-18fa-4280-9a40-e083b4c76156 service nova] Enqueued Resource ID: 067fee7b-ad4e-46d1-aecf-00957b3ffa7a with Priority: HIGHEST for action port [ 898.823536] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_rules [ 898.823536] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_members [ 898.823536] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 067fee7b-ad4e-46d1-aecf-00957b3ffa7a with Priority: HIGHEST for action port [ 898.823536] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.823536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.824452] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.824452] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.824452] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-067fee7b-ad4e-46d1-aecf-00957b3ffa7a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.824452] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-067fee7b-ad4e-46d1-aecf-00957b3ffa7a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.824452] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-067fee7b-ad4e-46d1-aecf-00957b3ffa7a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.824452] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-067fee7b-ad4e-46d1-aecf-00957b3ffa7a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.824452] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('067fee7b-ad4e-46d1-aecf-00957b3ffa7a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.898539] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.898669] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.898762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.899485] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.899485] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.155455] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: SUCCESS [ 899.156814] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.308790] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: SUCCESS [ 899.308996] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.309171] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.309392] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.309570] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.309730] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.309832] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.310053] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.310216] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.310304] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.310399] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.311812] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.311974] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.312148] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.312293] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.312330] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.312445] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.312523] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.312613] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.327901] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 067fee7b-ad4e-46d1-aecf-00957b3ffa7a with status ACTIVE [ 899.328130] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.328258] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.328332] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.328569] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.328658] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.328885] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.328938] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.328991] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.329142] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.329219] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.329399] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.329492] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.329552] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.329688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.329760] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.329845] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 067fee7b-ad4e-46d1-aecf-00957b3ffa7a is going to be updated. [ 899.356189] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.356336] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.356412] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.356707] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.356779] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.356909] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-067fee7b-ad4e-46d1-aecf-00957b3ffa7a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.401640] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.816455] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.816455] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.816455] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.905911] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.318518] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.409387] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 900.409387] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 900.822571] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.822729] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.823831] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.823831] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.823831] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.823831] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db is going to be updated. [ 900.858019] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.858181] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.858247] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.858464] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.858601] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.873485] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: IN_PROGRESS for 2s [ 901.312025] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.312025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.312025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.312025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.324936] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 901.326304] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.329036] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 901.356676] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.356676] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.356676] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.356676] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.370028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.370668] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 901.370756] env[70520]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70520) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 901.370840] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 901.410988] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.411172] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.411264] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.411495] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.412589] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.412849] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 901.488727] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.488727] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.488727] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.489017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.489017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.493022] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 901.563691] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.563691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.563691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.564017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.564178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.564979] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:35. [ 901.565181] env[70520]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'e84213b0-a32e-49bf-97aa-67c24de8104c', 'ada31481-82b9-4792-af47-296d5fe27a9f', 'eea0e866-b3b3-48be-a8a8-74b9431668cb', '6d7f9020-5060-4aaf-81f1-cec3849eacc0', '58197438-6dcb-404e-a8c1-aeacc2454958', '4e11ed3d-a638-4666-83ac-41d49f4f9874', '08b813e6-789a-4955-8d67-6d589f30969c', '49148979-263a-4c7a-a007-bfce9aaa037b', '4686572e-3137-42e1-a568-9db02b6e5e1c', 'd6f74242-a9a2-4ad8-bc5b-6c4f15b55180', '5ba096e8-0990-4301-b10d-dee4aea7793e', 'e2732d4c-390c-4309-8596-f408bd1b4ecf', '2449c3c4-f89c-449c-97e2-c22d5d72dbee', 'e7c44ea9-34f2-45bb-bf52-dd72b3513eda', '80751702-3cad-4ef3-af48-e8bd866c7e7f', '56132737-31b7-4de9-bac0-8ba06203bf23', 'e541827f-5a38-4732-ac7b-f8cf25dc1ec1', 'f07f408b-d949-4e30-bfe4-08c3628f17de', '9e0489ab-02aa-4b50-9561-5dc523b9b99a', '65c0ca8f-175d-4fd9-9598-89112bfad470', '3cc3c352-f711-4ecc-9064-0883727ce3ad', '1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3', '7be95060-a5a7-451a-a570-3386da846ca4', 'bc967d33-6d28-4dd5-98c4-22ac5cda2d2e', '7c9dafc4-e7ff-4514-ba35-e91b76e57256', '653491db-2944-4ea2-bef7-8e2800a4b41b', 'd202bbfa-42d6-4633-985f-b1007599bbf2', '89cb747a-f330-415b-bfd6-17be7d8807fb', '4cfd4659-cc60-4e40-83b3-09f036d8f58c', 'f4e36438-996a-4d8f-adfb-5a87b2e7bd82', 'a23aa860-12db-4b07-ac46-cf4709db7164', '22824640-0730-4b9a-a9ef-9014ef216bc4', '8b22ab11-3a43-4e3c-a9ac-8ee49b487341', '17f391db-1908-4d0d-afa1-a1da6f6944f6', '5d999f7b-50c9-40ee-b3b1-31ead407224c'} {{(pid=70520) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 901.565293] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 901.575011] env[70520]: INFO networking_nsxv3.common.synchronization [req-037382f2-ff91-4e89-88b0-d37b62f86d50 req-d679d98f-46f8-423a-8ce4-7e2972c19e3c tempest-ListImageFiltersTestJSON-785679465 tempest-ListImageFiltersTestJSON-785679465-project-member] Enqueued Resource ID: ada31481-82b9-4792-af47-296d5fe27a9f with Priority: HIGHEST for action security_group_members [ 901.575611] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ada31481-82b9-4792-af47-296d5fe27a9f with Priority: HIGHEST for action security_group_members [ 901.576024] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada31481-82b9-4792-af47-296d5fe27a9f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.576206] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.576308] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.576490] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.576703] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.576814] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.576871] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.577032] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.577122] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.577229] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ada31481-82b9-4792-af47-296d5fe27a9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.603654] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.603873] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.603873] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.604082] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.604169] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.604282] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 901.604344] env[70520]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70520) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 901.604470] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 901.682049] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.682259] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.682303] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.682833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.683333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.683552] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 901.684233] env[70520]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70520) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 901.684233] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 901.684233] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 901.684233] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/35 resources of Type:Security Group Rules [ 901.684233] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e84213b0-a32e-49bf-97aa-67c24de8104c with Priority: HIGH for action security_group_rules [ 901.684233] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ada31481-82b9-4792-af47-296d5fe27a9f with Priority: HIGH for action security_group_rules [ 901.684233] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eea0e866-b3b3-48be-a8a8-74b9431668cb with Priority: HIGH for action security_group_rules [ 901.684233] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGH for action security_group_rules [ 901.684233] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 58197438-6dcb-404e-a8c1-aeacc2454958 with Priority: HIGH for action security_group_rules [ 901.684576] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4e11ed3d-a638-4666-83ac-41d49f4f9874 with Priority: HIGH for action security_group_rules [ 901.684576] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 08b813e6-789a-4955-8d67-6d589f30969c with Priority: HIGH for action security_group_rules [ 901.684576] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 49148979-263a-4c7a-a007-bfce9aaa037b with Priority: HIGH for action security_group_rules [ 901.684576] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4686572e-3137-42e1-a568-9db02b6e5e1c with Priority: HIGH for action security_group_rules [ 901.684576] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 with Priority: HIGH for action security_group_rules [ 901.684576] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5ba096e8-0990-4301-b10d-dee4aea7793e with Priority: HIGH for action security_group_rules [ 901.684771] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e2732d4c-390c-4309-8596-f408bd1b4ecf with Priority: HIGH for action security_group_rules [ 901.684771] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee with Priority: HIGH for action security_group_rules [ 901.684771] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e7c44ea9-34f2-45bb-bf52-dd72b3513eda with Priority: HIGH for action security_group_rules [ 901.684867] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGH for action security_group_rules [ 901.684867] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 56132737-31b7-4de9-bac0-8ba06203bf23 with Priority: HIGH for action security_group_rules [ 901.684931] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e541827f-5a38-4732-ac7b-f8cf25dc1ec1 with Priority: HIGH for action security_group_rules [ 901.684964] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f07f408b-d949-4e30-bfe4-08c3628f17de with Priority: HIGH for action security_group_rules [ 901.685159] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9e0489ab-02aa-4b50-9561-5dc523b9b99a with Priority: HIGH for action security_group_rules [ 901.685159] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 65c0ca8f-175d-4fd9-9598-89112bfad470 with Priority: HIGH for action security_group_rules [ 901.685265] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.084113] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ada31481-82b9-4792-af47-296d5fe27a9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.590987] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ada31481-82b9-4792-af47-296d5fe27a9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.884591] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: SUCCESS [ 902.884849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.885073] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.885297] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.885564] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.885672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.885672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.885845] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.885935] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.886085] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.093775] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.093984] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.094212] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.094374] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.094495] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.094623] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ada31481-82b9-4792-af47-296d5fe27a9f is going to be updated. [ 903.129123] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.129123] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.129123] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.129123] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.129123] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.137961] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ada31481-82b9-4792-af47-296d5fe27a9f in Status: IN_PROGRESS for 2s [ 903.388702] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.891525] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.394752] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.394926] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.395974] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.395974] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.395974] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.395974] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db is going to be updated. [ 904.429694] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.429843] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.429920] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.430137] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.430280] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.440778] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: IN_PROGRESS for 2s [ 905.052241] env[70520]: INFO networking_nsxv3.common.synchronization [req-0ddebfa3-f463-4d68-8855-a43580105f32 req-88c98adf-864e-44ef-b2ce-81447b029633 tempest-AttachVolumeNegativeTest-1224878754 tempest-AttachVolumeNegativeTest-1224878754-project-member] Enqueued Resource ID: 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f with Priority: HIGHEST for action security_group_members [ 905.053016] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f with Priority: HIGHEST for action security_group_members [ 905.053016] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84213b0-a32e-49bf-97aa-67c24de8104c with Priority: HIGH for action security_group_rules [ 905.053179] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eea0e866-b3b3-48be-a8a8-74b9431668cb with Priority: HIGH for action security_group_rules [ 905.053179] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08b813e6-789a-4955-8d67-6d589f30969c with Priority: HIGH for action security_group_rules [ 905.053269] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGH for action security_group_rules [ 905.053339] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65c0ca8f-175d-4fd9-9598-89112bfad470 with Priority: HIGH for action security_group_rules [ 905.053436] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e0489ab-02aa-4b50-9561-5dc523b9b99a with Priority: HIGH for action security_group_rules [ 905.053554] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f07f408b-d949-4e30-bfe4-08c3628f17de with Priority: HIGH for action security_group_rules [ 905.053653] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e541827f-5a38-4732-ac7b-f8cf25dc1ec1 with Priority: HIGH for action security_group_rules [ 905.053743] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c44ea9-34f2-45bb-bf52-dd72b3513eda with Priority: HIGH for action security_group_rules [ 905.053829] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56132737-31b7-4de9-bac0-8ba06203bf23 with Priority: HIGH for action security_group_rules [ 905.053914] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee with Priority: HIGH for action security_group_rules [ 905.053998] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2732d4c-390c-4309-8596-f408bd1b4ecf with Priority: HIGH for action security_group_rules [ 905.055522] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ba096e8-0990-4301-b10d-dee4aea7793e with Priority: HIGH for action security_group_rules [ 905.055695] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 with Priority: HIGH for action security_group_rules [ 905.055841] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4686572e-3137-42e1-a568-9db02b6e5e1c with Priority: HIGH for action security_group_rules [ 905.055972] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e11ed3d-a638-4666-83ac-41d49f4f9874 with Priority: HIGH for action security_group_rules [ 905.056125] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49148979-263a-4c7a-a007-bfce9aaa037b with Priority: HIGH for action security_group_rules [ 905.056315] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58197438-6dcb-404e-a8c1-aeacc2454958 with Priority: HIGH for action security_group_rules [ 905.057390] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ada31481-82b9-4792-af47-296d5fe27a9f with Priority: HIGH for action security_group_rules [ 905.057495] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGH for action security_group_rules [ 905.057845] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.058022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.058118] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.058448] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.058660] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.058854] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.058999] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.059164] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.059288] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.059422] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8af5cf3c-e464-4241-82ec-9fc46dc5ae9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.060771] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e84213b0-a32e-49bf-97aa-67c24de8104c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.060967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.061077] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.061279] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.061544] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e84213b0-a32e-49bf-97aa-67c24de8104c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.062638] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eea0e866-b3b3-48be-a8a8-74b9431668cb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.062802] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.062998] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.063162] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.063291] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eea0e866-b3b3-48be-a8a8-74b9431668cb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.064354] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08b813e6-789a-4955-8d67-6d589f30969c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.064545] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.064738] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.064902] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.064999] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08b813e6-789a-4955-8d67-6d589f30969c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.066116] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.066313] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.066430] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.066631] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.066748] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.068182] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65c0ca8f-175d-4fd9-9598-89112bfad470 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.068347] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.068440] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.068620] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.068719] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65c0ca8f-175d-4fd9-9598-89112bfad470',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.069825] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e0489ab-02aa-4b50-9561-5dc523b9b99a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.069970] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.070112] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.070339] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.070422] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e0489ab-02aa-4b50-9561-5dc523b9b99a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.071259] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f07f408b-d949-4e30-bfe4-08c3628f17de taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.071361] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.071523] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.071657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.071746] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f07f408b-d949-4e30-bfe4-08c3628f17de',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.072800] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e541827f-5a38-4732-ac7b-f8cf25dc1ec1 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.072933] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.073028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.073394] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.073451] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e541827f-5a38-4732-ac7b-f8cf25dc1ec1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.074418] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7c44ea9-34f2-45bb-bf52-dd72b3513eda taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.074780] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.074895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.075186] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.075186] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7c44ea9-34f2-45bb-bf52-dd72b3513eda',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.076101] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56132737-31b7-4de9-bac0-8ba06203bf23 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.076315] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.076417] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.076595] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.076687] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56132737-31b7-4de9-bac0-8ba06203bf23',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.076935] env[70520]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 905.077652] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.077772] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.077860] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.078199] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.078274] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2449c3c4-f89c-449c-97e2-c22d5d72dbee',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.079635] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2732d4c-390c-4309-8596-f408bd1b4ecf taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.079739] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.079799] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.079990] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.080108] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2732d4c-390c-4309-8596-f408bd1b4ecf',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.081177] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ba096e8-0990-4301-b10d-dee4aea7793e taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.081247] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.082534] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.082534] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.082534] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ba096e8-0990-4301-b10d-dee4aea7793e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.084491] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.084491] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.084491] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.084491] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.084773] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6f74242-a9a2-4ad8-bc5b-6c4f15b55180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.085464] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4686572e-3137-42e1-a568-9db02b6e5e1c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.085601] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.085698] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.085866] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.085979] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4686572e-3137-42e1-a568-9db02b6e5e1c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.086819] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e11ed3d-a638-4666-83ac-41d49f4f9874 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.086948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.087058] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.087322] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.087374] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e11ed3d-a638-4666-83ac-41d49f4f9874',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.088221] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49148979-263a-4c7a-a007-bfce9aaa037b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.088375] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.088623] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.088989] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.089073] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49148979-263a-4c7a-a007-bfce9aaa037b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.091066] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58197438-6dcb-404e-a8c1-aeacc2454958 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.091066] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.091066] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.091066] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.091066] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58197438-6dcb-404e-a8c1-aeacc2454958',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.091576] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ada31481-82b9-4792-af47-296d5fe27a9f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.091576] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.091576] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.091761] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.091815] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ada31481-82b9-4792-af47-296d5fe27a9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.092757] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.092877] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.092921] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.093114] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.093210] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.093455] env[70520]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 905.149418] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ada31481-82b9-4792-af47-296d5fe27a9f in Status: SUCCESS [ 905.149966] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.503269] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-811 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.505018] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-811" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.505018] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-811" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.505018] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-811" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.505018] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.505018] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.505018] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.505018] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.505018] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.505511] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 905.505511] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 905.505511] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 905.505511] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 905.505669] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 905.505669] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 905.505862] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 905.525242] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 905.525426] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 905.525565] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 905.525744] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-811" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.526083] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-677a3854-7c81-4701-acde-f6948eccc5a1 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.526336] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-677a3854-7c81-4701-acde-f6948eccc5a1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.526463] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-677a3854-7c81-4701-acde-f6948eccc5a1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.526894] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-677a3854-7c81-4701-acde-f6948eccc5a1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.527076] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('677a3854-7c81-4701-acde-f6948eccc5a1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.596509] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.596599] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.596649] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.596856] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.596949] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.597166] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.597307] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.597369] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.597513] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.597589] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.597676] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f already deleted. [ 905.597755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.619669] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.619902] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.619902] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.620018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.622629] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.622629] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.627505] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2732d4c-390c-4309-8596-f408bd1b4ecf taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.627505] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.627505] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.627505] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.627505] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.627505] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.627505] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.627505] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.627505] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.628248] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.628374] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2732d4c-390c-4309-8596-f408bd1b4ecf',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.639025] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-4686572e-3137-42e1-a568-9db02b6e5e1c taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.639025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.639025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.639025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.639025] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.643025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.643025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.643025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.643025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.643025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.643025] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4686572e-3137-42e1-a568-9db02b6e5e1c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.646611] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-2449c3c4-f89c-449c-97e2-c22d5d72dbee taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.647014] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.647237] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.647608] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.647942] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.648224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.648901] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.649268] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.649610] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.650276] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.651028] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2449c3c4-f89c-449c-97e2-c22d5d72dbee',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.656028] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada31481-82b9-4792-af47-296d5fe27a9f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.656028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.656028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.656028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.805749] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.805982] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.806068] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.806396] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.806512] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.806572] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.806653] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ada31481-82b9-4792-af47-296d5fe27a9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.811716] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d7f9020-5060-4aaf-81f1-cec3849eacc0 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.811917] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.811917] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.812216] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.812332] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.812431] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.812486] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.812636] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.812708] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.812793] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.812873] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.814772] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-58197438-6dcb-404e-a8c1-aeacc2454958 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.814892] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.814941] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.815182] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.815309] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.815408] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.815468] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.815611] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.815690] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.815772] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.815853] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58197438-6dcb-404e-a8c1-aeacc2454958',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.822321] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.822476] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eea0e866-b3b3-48be-a8a8-74b9431668cb is going to be deleted. [ 905.828590] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2449c3c4-f89c-449c-97e2-c22d5d72dbee',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.829572] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada31481-82b9-4792-af47-296d5fe27a9f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.829724] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.829788] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.829937] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.830099] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.830201] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.830263] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.830408] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.830488] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.830571] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.830710] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada31481-82b9-4792-af47-296d5fe27a9f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.830800] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.830860] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.830995] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.831143] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.831233] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.831294] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.831432] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.831496] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.831576] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.831656] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ada31481-82b9-4792-af47-296d5fe27a9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.833821] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.834011] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.840351] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2449c3c4-f89c-449c-97e2-c22d5d72dbee: rpc.has_security_group_logging(os_id): False [ 905.841963] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58197438-6dcb-404e-a8c1-aeacc2454958',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.863256] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.863392] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.864184] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.864273] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.866594] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.866724] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.868654] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.868654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.871149] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.871149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.872317] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.872547] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.876293] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.876293] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.879479] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.879772] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.882188] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.883054] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.883718] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.883822] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.885759] env[70520]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 905.886297] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.886439] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.888607] env[70520]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 905.889070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.889207] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e84213b0-a32e-49bf-97aa-67c24de8104c is going to be deleted. [ 905.890151] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.890317] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.891912] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.892039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.892794] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.892891] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.913607] env[70520]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 905.914260] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.914398] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7c44ea9-34f2-45bb-bf52-dd72b3513eda is going to be deleted. [ 905.915377] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.915565] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.934673] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.934821] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.939303] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.939456] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e11ed3d-a638-4666-83ac-41d49f4f9874 is going to be deleted. [ 905.940379] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.940615] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.949351] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.949351] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.960857] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.960857] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49148979-263a-4c7a-a007-bfce9aaa037b is going to be deleted. [ 905.962060] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.962060] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.975441] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.975650] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.982156] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.982328] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6f74242-a9a2-4ad8-bc5b-6c4f15b55180 is going to be deleted. [ 905.983485] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.983736] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.006571] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.006742] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.029560] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.029802] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.029929] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.030324] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.030516] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.030679] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 677a3854-7c81-4701-acde-f6948eccc5a1 not found, creating... [ 906.030958] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.031143] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.031270] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.031546] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.031685] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.031983] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.032190] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.032313] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.032532] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.032676] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.032808] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 677a3854-7c81-4701-acde-f6948eccc5a1 is going to be created. [ 906.034718] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.034851] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56132737-31b7-4de9-bac0-8ba06203bf23 is going to be deleted. [ 906.035721] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.035841] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.069232] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.069694] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.076276] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.076500] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.080028] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.080282] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.080282] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.080572] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.080836] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.081063] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-677a3854-7c81-4701-acde-f6948eccc5a1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.082985] env[70520]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 906.083105] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.083155] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e541827f-5a38-4732-ac7b-f8cf25dc1ec1 is going to be deleted. [ 906.084131] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.084353] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.132038] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2732d4c-390c-4309-8596-f408bd1b4ecf',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.153919] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.153919] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ba096e8-0990-4301-b10d-dee4aea7793e is going to be deleted. [ 906.155151] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.155381] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.197360] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.197550] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e0489ab-02aa-4b50-9561-5dc523b9b99a is going to be deleted. [ 906.198580] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.198878] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.267254] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.267254] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.310662] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.311047] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.311180] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.311255] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.311532] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.311626] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.311758] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee is going to be updated. [ 906.313073] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.313340] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.315237] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.315381] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.322774] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.322774] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4686572e-3137-42e1-a568-9db02b6e5e1c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.326694] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.326838] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.342991] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ada31481-82b9-4792-af47-296d5fe27a9f: rpc.has_security_group_logging(os_id): False [ 906.344744] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58197438-6dcb-404e-a8c1-aeacc2454958: rpc.has_security_group_logging(os_id): False [ 906.378116] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.378373] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.379810] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.380102] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f is going to be deleted. [ 906.381724] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.382063] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.384821] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.384997] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.435984] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.436190] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.454386] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: SUCCESS [ 906.454683] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.454863] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.455166] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.455424] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.455582] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.455656] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.455825] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.455900] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.455991] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.456214] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.456322] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.457317] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.457317] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.457317] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.457317] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.457317] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.457317] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.457317] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.457317] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.457317] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.460251] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.460365] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08b813e6-789a-4955-8d67-6d589f30969c is going to be deleted. [ 906.461468] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.461588] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.496601] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.496839] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f07f408b-d949-4e30-bfe4-08c3628f17de is going to be deleted. [ 906.497787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.498039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.498151] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.498283] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eea0e866-b3b3-48be-a8a8-74b9431668cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.498523] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.498766] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.498876] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.499048] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e84213b0-a32e-49bf-97aa-67c24de8104c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.500027] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.500223] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.500311] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.500431] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7c44ea9-34f2-45bb-bf52-dd72b3513eda" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.500599] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.500768] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.500849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.501064] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e11ed3d-a638-4666-83ac-41d49f4f9874" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.501232] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.501385] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.501461] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.501583] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49148979-263a-4c7a-a007-bfce9aaa037b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.501713] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.501857] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.501924] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.502049] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6f74242-a9a2-4ad8-bc5b-6c4f15b55180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.502622] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.502622] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.502622] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.502622] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56132737-31b7-4de9-bac0-8ba06203bf23" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.502622] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.503045] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.531172] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.531405] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65c0ca8f-175d-4fd9-9598-89112bfad470 is going to be deleted. [ 906.532733] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.533082] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.533248] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.533477] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e541827f-5a38-4732-ac7b-f8cf25dc1ec1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.535382] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.535632] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.535723] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.535931] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.536129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.537296] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.537509] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.537601] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.537708] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ba096e8-0990-4301-b10d-dee4aea7793e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.538240] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.538406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.569027] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee in Status: IN_PROGRESS for 2s [ 906.577853] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.578238] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.578399] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.578474] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.578855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.578971] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.579239] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.579448] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.579448] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.579625] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.579733] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.579957] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.580090] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.580162] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.580412] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.580574] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.580631] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ada31481-82b9-4792-af47-296d5fe27a9f is going to be updated. [ 906.582015] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.582216] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.592777] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.593016] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.625444] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.625630] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.634355] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2732d4c-390c-4309-8596-f408bd1b4ecf: rpc.has_security_group_logging(os_id): False [ 906.667401] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.671028] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.671028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.671028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.671028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.671028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.671028] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58197438-6dcb-404e-a8c1-aeacc2454958 is going to be updated. [ 906.671028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.671028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.671028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.671028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e0489ab-02aa-4b50-9561-5dc523b9b99a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.671028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.671028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.671028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.671028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.672015] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.672313] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.672548] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.672684] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08b813e6-789a-4955-8d67-6d589f30969c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.685795] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.686200] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.686309] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.686566] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.720526] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.720672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.746996] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.747197] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.752349] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.752884] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.753104] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.753301] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.753440] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.753591] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.753746] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2732d4c-390c-4309-8596-f408bd1b4ecf is going to be updated. [ 906.758683] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.758683] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.758683] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.758683] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f07f408b-d949-4e30-bfe4-08c3628f17de" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.758683] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.758683] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.758683] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.759046] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65c0ca8f-175d-4fd9-9598-89112bfad470" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.771540] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.771782] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.771782] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.772044] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.772191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.802844] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ada31481-82b9-4792-af47-296d5fe27a9f in Status: IN_PROGRESS for 2s [ 906.824823] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d7f9020-5060-4aaf-81f1-cec3849eacc0: rpc.has_security_group_logging(os_id): False [ 906.825904] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4686572e-3137-42e1-a568-9db02b6e5e1c: rpc.has_security_group_logging(os_id): False [ 906.850605] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.850605] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.850605] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.850605] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.850605] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.890470] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.890696] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.890696] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.890909] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.894723] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.894863] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.902326] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58197438-6dcb-404e-a8c1-aeacc2454958 in Status: IN_PROGRESS for 2s [ 906.936409] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.936841] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.936957] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.937040] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.937327] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.937414] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.937496] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 is going to be updated. [ 906.940902] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.940902] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.961048] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d3e2e95-1306-419d-a0f9-f4e048bfb7db: rpc.has_security_group_logging(os_id): False [ 906.992120] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.992120] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.011825] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.011825] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.012680] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.013031] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.013231] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.019840] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.019840] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.019840] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.019840] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4686572e-3137-42e1-a568-9db02b6e5e1c is going to be updated. [ 907.019840] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.019840] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.019840] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.021082] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.021335] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.021478] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.021766] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.022323] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.022454] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.022668] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.026535] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.026706] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.026785] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.026856] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.027405] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.027405] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.027405] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.027596] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.027596] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.027895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.027895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.027895] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db is going to be created. [ 907.063978] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2732d4c-390c-4309-8596-f408bd1b4ecf in Status: IN_PROGRESS for 2s [ 907.100359] env[70520]: INFO networking_nsxv3.common.synchronization [req-0ddebfa3-f463-4d68-8855-a43580105f32 req-08e95688-61bd-4d7f-97d9-1895f2defa6a service nova] Enqueued Resource ID: 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f with Priority: HIGHEST for action security_group_rules [ 907.100756] env[70520]: INFO networking_nsxv3.common.synchronization [req-0ddebfa3-f463-4d68-8855-a43580105f32 req-08e95688-61bd-4d7f-97d9-1895f2defa6a service nova] Enqueued Resource ID: 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f with Priority: HIGHEST for action security_group_members [ 907.100756] env[70520]: INFO networking_nsxv3.common.synchronization [req-0ddebfa3-f463-4d68-8855-a43580105f32 req-08e95688-61bd-4d7f-97d9-1895f2defa6a service nova] Enqueued Resource ID: 677a3854-7c81-4701-acde-f6948eccc5a1 with Priority: HIGHEST for action port [ 907.101181] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f with Priority: HIGHEST for action security_group_rules [ 907.101321] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f with Priority: HIGHEST for action security_group_members [ 907.101421] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 677a3854-7c81-4701-acde-f6948eccc5a1 with Priority: HIGHEST for action port [ 907.108191] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.108191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.108191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.108191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.108191] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8af5cf3c-e464-4241-82ec-9fc46dc5ae9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.108447] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.109365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.109365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.109365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.109365] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.109365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.109365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.109762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.109762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.109762] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8af5cf3c-e464-4241-82ec-9fc46dc5ae9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.110531] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-677a3854-7c81-4701-acde-f6948eccc5a1 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.110659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-677a3854-7c81-4701-acde-f6948eccc5a1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.110659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-677a3854-7c81-4701-acde-f6948eccc5a1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.110832] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-677a3854-7c81-4701-acde-f6948eccc5a1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.110904] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('677a3854-7c81-4701-acde-f6948eccc5a1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.113798] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.113919] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.113961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.114193] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.114323] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.137970] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: IN_PROGRESS for 2s [ 907.151402] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.151713] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.151834] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.152164] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.152424] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.156889] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.157120] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.157342] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.157623] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.157834] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.178674] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: IN_PROGRESS for 2s [ 907.180333] env[70520]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 907.180740] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4686572e-3137-42e1-a568-9db02b6e5e1c in Status: IN_PROGRESS for 2s [ 907.613119] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.613310] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.613361] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8af5cf3c-e464-4241-82ec-9fc46dc5ae9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.614371] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 677a3854-7c81-4701-acde-f6948eccc5a1 with status ACTIVE [ 907.615441] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.615441] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.615441] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.615441] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.615441] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.615441] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.615441] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.615441] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.616262] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.616262] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.616262] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.616262] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.616262] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.616262] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.616477] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.616477] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 677a3854-7c81-4701-acde-f6948eccc5a1 is going to be updated. [ 907.640097] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.640319] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.640319] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.640553] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.640658] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.640811] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-677a3854-7c81-4701-acde-f6948eccc5a1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.118486] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8af5cf3c-e464-4241-82ec-9fc46dc5ae9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.584188] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee in Status: SUCCESS [ 908.584422] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.623035] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.624042] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.624042] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.624209] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.624460] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.624460] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f is going to be created. [ 908.650932] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.650932] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.650932] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.650932] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.651118] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.662982] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f in Status: UNINITIALIZED for 2s [ 908.817481] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ada31481-82b9-4792-af47-296d5fe27a9f in Status: SUCCESS [ 908.817827] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.920727] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58197438-6dcb-404e-a8c1-aeacc2454958 in Status: SUCCESS [ 908.921140] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.080272] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2732d4c-390c-4309-8596-f408bd1b4ecf in Status: SUCCESS [ 909.081100] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.156978] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: SUCCESS [ 909.156978] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.215613] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4686572e-3137-42e1-a568-9db02b6e5e1c in Status: SUCCESS [ 909.215613] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.217902] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: SUCCESS [ 909.218637] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.218637] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.218837] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.218837] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.721576] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.721783] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.721876] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.726373] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.726644] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.730105] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.730105] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.730105] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.730105] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.730105] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.730105] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.229269] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.229823] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.229823] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.231184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.231413] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.231569] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.235020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.235020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.235020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.235020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.235020] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.235020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.235020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.235020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.235020] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.235020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.235020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.235020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.235020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.235020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.235020] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.673847] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f in Status: SUCCESS [ 910.674142] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.674309] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.674558] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.674760] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.674881] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.674946] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.675198] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.675393] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.675470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.675713] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8af5cf3c-e464-4241-82ec-9fc46dc5ae9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.740751] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d3e2e95-1306-419d-a0f9-f4e048bfb7db: rpc.has_security_group_logging(os_id): False [ 910.759324] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.759565] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.759628] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.759860] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.759981] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.760214] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.760342] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.760423] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.760633] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.761018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.762064] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.762064] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.762064] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.762064] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.762064] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.762064] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.762064] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.762727] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.762727] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.762727] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.762727] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db is going to be updated. [ 910.826505] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.826666] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.827279] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.827279] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.827279] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.846988] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: IN_PROGRESS for 2s [ 911.178415] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8af5cf3c-e464-4241-82ec-9fc46dc5ae9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.441646] env[70520]: INFO networking_nsxv3.common.synchronization [req-547cb376-0316-402e-af6f-04135f5d52ec req-233c6136-b12d-4d80-8e50-4f922278f6b4 tempest-MultipleCreateTestJSON-1344547532 tempest-MultipleCreateTestJSON-1344547532-project-member] Enqueued Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_members [ 911.441936] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_members [ 911.442295] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.442295] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.442414] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.442556] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.442699] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.442789] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.442846] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.443511] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.443644] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.443742] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.682231] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f: rpc.has_security_group_logging(os_id): False [ 911.705178] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.705178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.705178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.705178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.705178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.705178] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.705178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.705178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.705178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.705178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.705178] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f is going to be created. [ 911.769542] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.770434] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.770594] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.770857] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.771138] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.781638] env[70520]: INFO networking_nsxv3.common.synchronization [req-01ecb55f-0660-4b71-91a3-1dd681430d31 req-dbfb0801-3063-46f4-b472-3d96d21ae5c3 tempest-MultipleCreateTestJSON-1344547532 tempest-MultipleCreateTestJSON-1344547532-project-member] Enqueued Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_members [ 911.783122] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_members [ 911.783484] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.783618] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.786027] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f in Status: IN_PROGRESS for 2s [ 911.947579] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.455416] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.680560] env[70520]: INFO networking_nsxv3.common.synchronization [None req-26ee23bd-680f-4b21-b984-25990d83d93b None None] Enqueued Resource ID: 8fe7abf9-f852-4b9f-9bf1-560eafa03244 with Priority: HIGHEST for action port [ 912.680828] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fe7abf9-f852-4b9f-9bf1-560eafa03244 with Priority: HIGHEST for action port [ 912.681502] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-8fe7abf9-f852-4b9f-9bf1-560eafa03244 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.681793] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8fe7abf9-f852-4b9f-9bf1-560eafa03244" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.681895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8fe7abf9-f852-4b9f-9bf1-560eafa03244" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.682254] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8fe7abf9-f852-4b9f-9bf1-560eafa03244" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.682374] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fe7abf9-f852-4b9f-9bf1-560eafa03244',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.863334] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: SUCCESS [ 912.863334] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.958574] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.958723] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.958792] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.962023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.962023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.962023] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db is going to be updated. [ 912.994454] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.994454] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.994454] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.994454] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.994454] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.001951] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: IN_PROGRESS for 2s [ 913.184607] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8fe7abf9-f852-4b9f-9bf1-560eafa03244 [ 913.187035] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.187035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.187035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.187035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.187035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.187035] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8fe7abf9-f852-4b9f-9bf1-560eafa03244 already deleted. [ 913.187035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8fe7abf9-f852-4b9f-9bf1-560eafa03244" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.803504] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f in Status: SUCCESS [ 913.803802] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.016826] env[70520]: INFO networking_nsxv3.common.synchronization [None req-0f81cceb-94ff-4b82-83e9-c76b112699b0 tempest-ServersTestBootFromVolume-1414622987 tempest-ServersTestBootFromVolume-1414622987-project-member] Enqueued Resource ID: e1706c97-ada0-42a9-ae16-d557fcd51adb with Priority: HIGHEST for action security_group_rules [ 914.017347] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1706c97-ada0-42a9-ae16-d557fcd51adb with Priority: HIGHEST for action security_group_rules [ 914.017868] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1706c97-ada0-42a9-ae16-d557fcd51adb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.018529] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.018529] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.018714] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.018714] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1706c97-ada0-42a9-ae16-d557fcd51adb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.188747] env[70520]: INFO networking_nsxv3.common.synchronization [None req-319a697f-0365-4403-b6cb-5ae522e0a3d8 tempest-ServersTestBootFromVolume-1414622987 tempest-ServersTestBootFromVolume-1414622987-project-member] Enqueued Resource ID: e1706c97-ada0-42a9-ae16-d557fcd51adb with Priority: HIGHEST for action security_group_rules [ 914.189379] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1706c97-ada0-42a9-ae16-d557fcd51adb with Priority: HIGHEST for action security_group_rules [ 914.190030] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1706c97-ada0-42a9-ae16-d557fcd51adb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.190030] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.543390] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.543570] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.543621] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.543885] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.544022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.544194] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1706c97-ada0-42a9-ae16-d557fcd51adb already deleted. [ 914.544310] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.544481] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.544678] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.544770] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1706c97-ada0-42a9-ae16-d557fcd51adb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.722942] env[70520]: INFO networking_nsxv3.common.synchronization [None req-84b3ba0a-233e-4aeb-a990-4a570a2f894f None None] Enqueued Resource ID: ee95269f-5298-42df-bc27-2af33c329b47 with Priority: HIGHEST for action port [ 914.724736] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee95269f-5298-42df-bc27-2af33c329b47 with Priority: HIGHEST for action port [ 914.725257] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee95269f-5298-42df-bc27-2af33c329b47 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.726790] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee95269f-5298-42df-bc27-2af33c329b47" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.726931] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee95269f-5298-42df-bc27-2af33c329b47" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.727277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee95269f-5298-42df-bc27-2af33c329b47" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.727364] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee95269f-5298-42df-bc27-2af33c329b47',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.013073] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: SUCCESS [ 915.013431] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.014852] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.014852] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.014852] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.014852] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.014852] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.014852] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.014852] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.014852] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.076194] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.076441] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.076568] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.079040] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.079040] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.079040] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1706c97-ada0-42a9-ae16-d557fcd51adb already deleted. [ 915.079040] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.079260] env[70520]: INFO networking_nsxv3.common.synchronization [req-8aab5392-426e-4747-af99-139c731a84b0 req-a3ab9daa-527b-44cf-8e22-e3acb002f66a tempest-VolumesAssistedSnapshotsTest-545368338 tempest-VolumesAssistedSnapshotsTest-545368338-project-member] Enqueued Resource ID: e2732d4c-390c-4309-8596-f408bd1b4ecf with Priority: HIGHEST for action security_group_members [ 915.079780] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2732d4c-390c-4309-8596-f408bd1b4ecf with Priority: HIGHEST for action security_group_members [ 915.080152] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2732d4c-390c-4309-8596-f408bd1b4ecf taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.080384] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.080384] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.080678] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.080718] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.080799] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.080857] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.082591] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.082591] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.082591] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2732d4c-390c-4309-8596-f408bd1b4ecf',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.232767] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee95269f-5298-42df-bc27-2af33c329b47 [ 915.233028] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.233168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.233238] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.233453] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.233539] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.233634] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ee95269f-5298-42df-bc27-2af33c329b47 already deleted. [ 915.233714] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee95269f-5298-42df-bc27-2af33c329b47" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.521352] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.521352] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.521352] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.521352] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.521352] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.521352] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.521352] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.521352] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.521352] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.521352] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.521352] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db is going to be updated. [ 915.563819] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.564042] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.564094] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.564280] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.564419] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.590178] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: IN_PROGRESS for 2s [ 915.590178] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.590178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.590178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.590178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.590178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.590178] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.590178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.590178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.590178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.590178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.590178] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2732d4c-390c-4309-8596-f408bd1b4ecf is going to be updated. [ 915.621730] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.621885] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.621956] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.622188] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.622333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.637626] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2732d4c-390c-4309-8596-f408bd1b4ecf in Status: IN_PROGRESS for 2s [ 917.597675] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: SUCCESS [ 917.597675] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db deletion is rescheduled due to dependency. [ 917.597675] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.652453] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2732d4c-390c-4309-8596-f408bd1b4ecf in Status: SUCCESS [ 917.652625] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2732d4c-390c-4309-8596-f408bd1b4ecf deletion is rescheduled due to dependency. [ 917.652820] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.956326] env[70520]: INFO networking_nsxv3.common.synchronization [req-d377a479-0568-4da1-a19a-6177f358465c req-1ab3c6fa-2f98-4d4a-9796-bf197c061739 tempest-ServerActionsTestOtherA-325270290 tempest-ServerActionsTestOtherA-325270290-project-member] Enqueued Resource ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 with Priority: HIGHEST for action security_group_members [ 919.956904] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 with Priority: HIGHEST for action security_group_members [ 919.957244] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fc21783-a665-46f8-bdde-7d13f7923e03 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.957377] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.957454] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.957869] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.957869] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.958113] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.959376] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.959599] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.959806] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.959928] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fc21783-a665-46f8-bdde-7d13f7923e03',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.462838] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.462997] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.463075] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.463298] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.463391] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.463594] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.463693] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.463794] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.463898] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.463981] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.464224] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 already deleted. [ 920.464224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.530155] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-572 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.530568] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-572" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.531315] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-572" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.531315] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-572" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.531577] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.531668] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.531785] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.532463] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.532463] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.532463] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 920.533370] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 920.533370] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 920.533370] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 920.533370] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 920.533370] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 920.533370] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 920.554784] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 920.555104] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 920.555346] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 920.555649] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-572" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.556112] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-245f5f8b-bcb1-46ef-a63b-d618abb0d2a4 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.556357] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-245f5f8b-bcb1-46ef-a63b-d618abb0d2a4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.556470] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-245f5f8b-bcb1-46ef-a63b-d618abb0d2a4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.556788] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-245f5f8b-bcb1-46ef-a63b-d618abb0d2a4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.556931] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('245f5f8b-bcb1-46ef-a63b-d618abb0d2a4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.059480] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.059966] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.060228] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.060828] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.061208] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.061511] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 245f5f8b-bcb1-46ef-a63b-d618abb0d2a4 not found, creating... [ 921.061875] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.062088] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.062247] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.062578] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.062825] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.063235] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.063474] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.063641] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.063926] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.064132] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.064343] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 245f5f8b-bcb1-46ef-a63b-d618abb0d2a4 is going to be created. [ 921.087875] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.088147] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.088336] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.088814] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.089175] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.089482] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-245f5f8b-bcb1-46ef-a63b-d618abb0d2a4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.895015] env[70520]: INFO networking_nsxv3.common.synchronization [req-d377a479-0568-4da1-a19a-6177f358465c req-80e2100b-43a1-418b-a304-4602acc0c424 service nova] Enqueued Resource ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 with Priority: HIGHEST for action security_group_rules [ 921.895277] env[70520]: INFO networking_nsxv3.common.synchronization [req-d377a479-0568-4da1-a19a-6177f358465c req-80e2100b-43a1-418b-a304-4602acc0c424 service nova] Enqueued Resource ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 with Priority: HIGHEST for action security_group_members [ 921.895363] env[70520]: INFO networking_nsxv3.common.synchronization [req-d377a479-0568-4da1-a19a-6177f358465c req-80e2100b-43a1-418b-a304-4602acc0c424 service nova] Enqueued Resource ID: 245f5f8b-bcb1-46ef-a63b-d618abb0d2a4 with Priority: HIGHEST for action port [ 921.895633] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 with Priority: HIGHEST for action security_group_rules [ 921.895729] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 with Priority: HIGHEST for action security_group_members [ 921.895823] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 245f5f8b-bcb1-46ef-a63b-d618abb0d2a4 with Priority: HIGHEST for action port [ 921.897017] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0fc21783-a665-46f8-bdde-7d13f7923e03 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.897017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.897017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.897017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.897017] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0fc21783-a665-46f8-bdde-7d13f7923e03',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.899117] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fc21783-a665-46f8-bdde-7d13f7923e03 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.899117] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.899254] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.899371] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.899528] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.899632] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.899697] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.899847] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.900110] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.900110] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fc21783-a665-46f8-bdde-7d13f7923e03',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.900872] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-245f5f8b-bcb1-46ef-a63b-d618abb0d2a4 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.901152] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-245f5f8b-bcb1-46ef-a63b-d618abb0d2a4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.901622] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-245f5f8b-bcb1-46ef-a63b-d618abb0d2a4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.901806] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-245f5f8b-bcb1-46ef-a63b-d618abb0d2a4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.901888] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('245f5f8b-bcb1-46ef-a63b-d618abb0d2a4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.403416] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0fc21783-a665-46f8-bdde-7d13f7923e03',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.404701] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fc21783-a665-46f8-bdde-7d13f7923e03 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.404868] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.405069] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 245f5f8b-bcb1-46ef-a63b-d618abb0d2a4 with status ACTIVE [ 922.405238] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.405368] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.405440] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.405629] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.405720] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.405891] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.405983] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.406076] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.406264] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.406457] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.407181] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.407384] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.407806] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.407972] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.408059] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.408152] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 245f5f8b-bcb1-46ef-a63b-d618abb0d2a4 is going to be updated. [ 922.434541] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.434681] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.434767] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.434958] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.435103] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.435256] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-245f5f8b-bcb1-46ef-a63b-d618abb0d2a4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.599794] env[70520]: INFO networking_nsxv3.common.synchronization [req-fedcfb5b-4e48-4af1-8027-e4acdd23ca05 req-33923cab-2830-4137-bedd-189ba6c5886d tempest-VolumesAdminNegativeTest-725810316 tempest-VolumesAdminNegativeTest-725810316-project-member] Enqueued Resource ID: 4686572e-3137-42e1-a568-9db02b6e5e1c with Priority: HIGHEST for action security_group_members [ 922.599794] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4686572e-3137-42e1-a568-9db02b6e5e1c with Priority: HIGHEST for action security_group_members [ 922.599794] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-4686572e-3137-42e1-a568-9db02b6e5e1c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.600817] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.600817] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.600948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.601146] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.601284] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.601395] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.601837] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.601954] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.602100] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4686572e-3137-42e1-a568-9db02b6e5e1c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.910461] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0fc21783-a665-46f8-bdde-7d13f7923e03',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.103952] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.104128] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.104211] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.104588] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.104703] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.104892] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.104995] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.105061] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.105218] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.105290] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.105374] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4686572e-3137-42e1-a568-9db02b6e5e1c is going to be updated. [ 923.135703] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.135847] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.135940] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.136179] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.136594] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.146690] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4686572e-3137-42e1-a568-9db02b6e5e1c in Status: IN_PROGRESS for 2s [ 923.412726] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.413129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.413129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.413218] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.413264] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.413957] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 is going to be created. [ 923.439305] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.439490] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.439548] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.439725] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.439883] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.450903] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 in Status: UNINITIALIZED for 2s [ 925.031019] env[70520]: INFO networking_nsxv3.common.synchronization [req-f5479e3e-1d95-4d51-bfb8-ffec42d52b3b req-ea665931-fb67-4573-86ad-53effef235e1 tempest-ImagesOneServerNegativeTestJSON-1115954637 tempest-ImagesOneServerNegativeTestJSON-1115954637-project-member] Enqueued Resource ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad with Priority: HIGHEST for action security_group_members [ 925.031019] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad with Priority: HIGHEST for action security_group_members [ 925.031019] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc3c352-f711-4ecc-9064-0883727ce3ad taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.032076] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.034047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.034047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.034047] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.034047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.034047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.034047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.034047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.034047] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cc3c352-f711-4ecc-9064-0883727ce3ad',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.157421] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4686572e-3137-42e1-a568-9db02b6e5e1c in Status: SUCCESS [ 925.157619] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4686572e-3137-42e1-a568-9db02b6e5e1c deletion is rescheduled due to dependency. [ 925.157731] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.366282] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-918 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.366282] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-918" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.366282] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-918" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.366282] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-918" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.366282] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.366282] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.366282] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.366282] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.366282] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.366282] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 925.366282] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 925.367081] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 925.367340] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 925.367737] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 925.367980] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 925.368276] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 925.397026] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 925.397026] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 925.397026] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 925.397026] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-918" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.397026] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-ea518aac-6d67-4de0-8e1e-76e452898856 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.397026] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-ea518aac-6d67-4de0-8e1e-76e452898856" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.397026] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-ea518aac-6d67-4de0-8e1e-76e452898856" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.397026] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-ea518aac-6d67-4de0-8e1e-76e452898856" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.397026] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea518aac-6d67-4de0-8e1e-76e452898856',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.462461] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 in Status: SUCCESS [ 925.463167] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.464273] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.464273] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.464273] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.464273] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.464273] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.465680] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.465680] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.465680] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.465680] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0fc21783-a665-46f8-bdde-7d13f7923e03',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.535457] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.535829] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.535952] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.536243] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.561285] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.561869] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.561869] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.561869] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.562112] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.562112] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.562112] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad is going to be updated. [ 925.600461] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.600650] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.600726] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.600955] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.601262] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.615027] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad in Status: IN_PROGRESS for 2s [ 925.900229] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.900468] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.900614] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.900898] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.901077] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.901238] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port ea518aac-6d67-4de0-8e1e-76e452898856 not found, creating... [ 925.901512] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.901676] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.901798] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.902231] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.902231] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.902456] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.902616] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.902755] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.902947] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.903101] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.903331] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: ea518aac-6d67-4de0-8e1e-76e452898856 is going to be created. [ 925.926980] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.927346] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.927564] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.929527] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.929527] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.929527] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-ea518aac-6d67-4de0-8e1e-76e452898856" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.968481] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0fc21783-a665-46f8-bdde-7d13f7923e03',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.471191] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0fc21783-a665-46f8-bdde-7d13f7923e03: rpc.has_security_group_logging(os_id): False [ 926.489594] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.489750] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.490399] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.490399] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.490399] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.490399] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.490730] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.490730] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.490730] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.490821] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.490957] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 is going to be created. [ 926.562176] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.562365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.562432] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.562591] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.562769] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.575893] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 in Status: IN_PROGRESS for 2s [ 926.734838] env[70520]: INFO networking_nsxv3.common.synchronization [req-f5479e3e-1d95-4d51-bfb8-ffec42d52b3b req-867da268-cc74-449f-9563-4ccc4b199380 service nova] Enqueued Resource ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad with Priority: HIGHEST for action security_group_rules [ 926.735060] env[70520]: INFO networking_nsxv3.common.synchronization [req-f5479e3e-1d95-4d51-bfb8-ffec42d52b3b req-867da268-cc74-449f-9563-4ccc4b199380 service nova] Enqueued Resource ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad with Priority: HIGHEST for action security_group_members [ 926.735208] env[70520]: INFO networking_nsxv3.common.synchronization [req-f5479e3e-1d95-4d51-bfb8-ffec42d52b3b req-867da268-cc74-449f-9563-4ccc4b199380 service nova] Enqueued Resource ID: ea518aac-6d67-4de0-8e1e-76e452898856 with Priority: HIGHEST for action port [ 926.735862] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad with Priority: HIGHEST for action security_group_rules [ 926.736015] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad with Priority: HIGHEST for action security_group_members [ 926.739985] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea518aac-6d67-4de0-8e1e-76e452898856 with Priority: HIGHEST for action port [ 926.740754] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cc3c352-f711-4ecc-9064-0883727ce3ad taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.740911] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.740988] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.741258] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.741365] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cc3c352-f711-4ecc-9064-0883727ce3ad',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.742864] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc3c352-f711-4ecc-9064-0883727ce3ad taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.742864] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.743106] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea518aac-6d67-4de0-8e1e-76e452898856 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.743246] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea518aac-6d67-4de0-8e1e-76e452898856" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.743314] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea518aac-6d67-4de0-8e1e-76e452898856" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.743508] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea518aac-6d67-4de0-8e1e-76e452898856" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.743581] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea518aac-6d67-4de0-8e1e-76e452898856',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.245618] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea518aac-6d67-4de0-8e1e-76e452898856 with status ACTIVE [ 927.245906] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.246051] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.246121] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.246353] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.246444] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.246623] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.246725] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.246787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.246951] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.247033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.247210] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.247295] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.247376] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.247526] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.247598] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.247682] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea518aac-6d67-4de0-8e1e-76e452898856 is going to be updated. [ 927.249824] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc3c352-f711-4ecc-9064-0883727ce3ad taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.249824] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.275450] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.275691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.275691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.275919] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.276066] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.276234] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea518aac-6d67-4de0-8e1e-76e452898856" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.648483] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad in Status: SUCCESS [ 927.648858] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad deletion is rescheduled due to dependency. [ 927.648858] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.648995] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.649233] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.649581] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.649716] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.649780] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.649943] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.650042] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.650125] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cc3c352-f711-4ecc-9064-0883727ce3ad',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.152866] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3cc3c352-f711-4ecc-9064-0883727ce3ad',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.587885] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 in Status: SUCCESS [ 928.588145] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.656257] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3cc3c352-f711-4ecc-9064-0883727ce3ad',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.158362] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.158537] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.158585] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.158782] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.158863] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.158958] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad is going to be updated. [ 929.220176] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.220176] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.220176] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.220176] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.220176] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.220176] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad in Status: IN_PROGRESS for 2s [ 931.217951] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad in Status: SUCCESS [ 931.218294] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.218294] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.218526] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.218731] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.218854] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.218913] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.219163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.219241] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.219454] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.219454] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3cc3c352-f711-4ecc-9064-0883727ce3ad',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.721692] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc3c352-f711-4ecc-9064-0883727ce3ad taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.721874] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.721928] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.722924] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.722924] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.722924] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.722924] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.722924] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.722924] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.722924] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.722924] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc3c352-f711-4ecc-9064-0883727ce3ad taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.723330] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.723330] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.723330] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.723330] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.723454] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.725632] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.725632] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.725632] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.725632] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.725632] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3cc3c352-f711-4ecc-9064-0883727ce3ad',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.741536] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 931.741870] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 932.228585] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3cc3c352-f711-4ecc-9064-0883727ce3ad: rpc.has_security_group_logging(os_id): False [ 932.250253] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.250477] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.250477] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.250668] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.250755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.250961] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.251130] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.251198] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.251365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.251444] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.251760] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.251869] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.252016] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.252207] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.252272] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.252487] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.252592] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.252654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.252772] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.252843] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.252924] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad is going to be updated. [ 932.326804] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.326986] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.327037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.330699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.330699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.340241] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad in Status: IN_PROGRESS for 2s [ 933.194272] env[70520]: INFO networking_nsxv3.common.synchronization [req-616fe518-7561-40e3-8f68-87ef60e9fe41 req-39942a1e-5e37-4e2a-ba85-da056ef0347c tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_members [ 933.195125] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_members [ 933.195515] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.195645] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.195714] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.195912] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.196072] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.196173] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.196233] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.196425] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.196490] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.196602] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.701133] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.898388] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.898586] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-653" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.898729] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-653" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.899042] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-653" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.899297] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.899462] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.899579] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.899846] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.899996] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.900222] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 933.900366] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 933.900434] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 933.900539] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 933.900644] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 933.900745] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 933.900874] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 933.923190] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 933.923381] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 933.923534] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 933.923767] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-653" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.924501] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-41fe9c56-a523-478e-bb8e-468c8411c6f1 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.924501] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-41fe9c56-a523-478e-bb8e-468c8411c6f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.924501] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-41fe9c56-a523-478e-bb8e-468c8411c6f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.924501] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-41fe9c56-a523-478e-bb8e-468c8411c6f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.924501] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41fe9c56-a523-478e-bb8e-468c8411c6f1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.201985] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.353810] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad in Status: SUCCESS [ 934.354330] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.428272] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.428500] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.428635] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.428943] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.429111] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.429272] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 41fe9c56-a523-478e-bb8e-468c8411c6f1 not found, creating... [ 934.429536] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.429705] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.429824] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.430092] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.430280] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.430571] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.430733] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.430853] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.431088] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.431242] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.431386] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 41fe9c56-a523-478e-bb8e-468c8411c6f1 is going to be created. [ 934.453712] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.453936] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.454078] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.454508] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.454783] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.455168] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-41fe9c56-a523-478e-bb8e-468c8411c6f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.705402] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.705402] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.705402] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.705402] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.705402] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.706115] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 is going to be updated. [ 934.864012] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.864012] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.864012] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.864012] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.864012] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.875948] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: IN_PROGRESS for 2s [ 935.298246] env[70520]: INFO networking_nsxv3.common.synchronization [req-616fe518-7561-40e3-8f68-87ef60e9fe41 req-96581a74-fbfa-4732-bd94-af86e445a779 service nova] Enqueued Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_rules [ 935.298452] env[70520]: INFO networking_nsxv3.common.synchronization [req-616fe518-7561-40e3-8f68-87ef60e9fe41 req-96581a74-fbfa-4732-bd94-af86e445a779 service nova] Enqueued Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_members [ 935.298667] env[70520]: INFO networking_nsxv3.common.synchronization [req-616fe518-7561-40e3-8f68-87ef60e9fe41 req-96581a74-fbfa-4732-bd94-af86e445a779 service nova] Enqueued Resource ID: 41fe9c56-a523-478e-bb8e-468c8411c6f1 with Priority: HIGHEST for action port [ 935.298914] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_rules [ 935.299083] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_members [ 935.299241] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41fe9c56-a523-478e-bb8e-468c8411c6f1 with Priority: HIGHEST for action port [ 935.299825] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.299953] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.300147] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.300380] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.300463] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.301673] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.301673] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.301673] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-41fe9c56-a523-478e-bb8e-468c8411c6f1 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.301815] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41fe9c56-a523-478e-bb8e-468c8411c6f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.301815] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41fe9c56-a523-478e-bb8e-468c8411c6f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.301952] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41fe9c56-a523-478e-bb8e-468c8411c6f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.302039] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41fe9c56-a523-478e-bb8e-468c8411c6f1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.725128] env[70520]: INFO networking_nsxv3.common.synchronization [req-8044007c-b69d-419a-972f-83f713dd27c7 req-81ee7bdb-13d1-4ffd-ae3c-9c7a3526d78a tempest-AttachInterfacesTestJSON-1687744298 tempest-AttachInterfacesTestJSON-1687744298-project-member] Enqueued Resource ID: 0775b802-20d8-4210-ad0d-b621a7b66c62 with Priority: HIGHEST for action security_group_members [ 935.725128] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0775b802-20d8-4210-ad0d-b621a7b66c62 with Priority: HIGHEST for action security_group_members [ 935.725128] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-0775b802-20d8-4210-ad0d-b621a7b66c62 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.725128] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.725128] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.725128] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.725128] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.725128] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.725850] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.726202] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.726443] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.727665] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0775b802-20d8-4210-ad0d-b621a7b66c62',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.804781] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.810880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.810880] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 41fe9c56-a523-478e-bb8e-468c8411c6f1 with status ACTIVE [ 935.810880] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.810880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.810880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.810880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.810880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.810880] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.810880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.810880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.810880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.810880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.810880] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.810880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.810880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.810880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.810880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.811470] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 41fe9c56-a523-478e-bb8e-468c8411c6f1 is going to be updated. [ 935.840769] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.842494] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.842802] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.842831] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.843063] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.843280] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41fe9c56-a523-478e-bb8e-468c8411c6f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.230385] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.230537] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.230537] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.230756] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.231034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.231034] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.231325] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.231325] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.231325] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.231519] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.231519] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0775b802-20d8-4210-ad0d-b621a7b66c62 already deleted. [ 936.231695] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.261243] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-631 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.261448] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.261569] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.261914] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.262222] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.263661] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.263661] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.263661] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.263661] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.263661] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 936.263661] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 936.263661] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 936.263661] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 936.263661] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 936.264033] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 936.264134] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 936.284213] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 936.284448] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 936.284608] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 936.284790] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.285120] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-52a5a97d-0b89-4670-a64e-15d625ce7af5 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.285303] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-52a5a97d-0b89-4670-a64e-15d625ce7af5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.285428] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-52a5a97d-0b89-4670-a64e-15d625ce7af5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.285756] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-52a5a97d-0b89-4670-a64e-15d625ce7af5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.285899] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52a5a97d-0b89-4670-a64e-15d625ce7af5',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.693807] env[70520]: INFO networking_nsxv3.common.synchronization [req-f7e0ecad-8e94-4329-9d39-97e38c29d701 req-626bb375-7449-4a0e-b72c-c7bf33598590 tempest-ServersWithSpecificFlavorTestJSON-1288943951 tempest-ServersWithSpecificFlavorTestJSON-1288943951-project-member] Enqueued Resource ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee with Priority: HIGHEST for action security_group_members [ 936.694355] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee with Priority: HIGHEST for action security_group_members [ 936.694664] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-2449c3c4-f89c-449c-97e2-c22d5d72dbee taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.694788] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.694848] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.695308] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.695484] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.695593] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.695655] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.695817] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.695902] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.695996] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2449c3c4-f89c-449c-97e2-c22d5d72dbee',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.789657] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.790033] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.790033] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.790306] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.790459] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.790618] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 52a5a97d-0b89-4670-a64e-15d625ce7af5 not found, creating... [ 936.790879] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.791106] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.791197] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.791423] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.791565] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.791895] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.792387] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.792387] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.793886] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.794101] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.794261] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 52a5a97d-0b89-4670-a64e-15d625ce7af5 is going to be created. [ 936.817855] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.818096] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.818225] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.818521] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.818750] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.818972] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-52a5a97d-0b89-4670-a64e-15d625ce7af5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.886629] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: SUCCESS [ 936.886629] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.886629] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.886629] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.887749] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.887749] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.887749] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.887749] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.887749] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.887749] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.199433] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.199433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.199433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.199433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.199612] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.199739] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.199810] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.199854] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.200069] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.200150] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.200238] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee is going to be updated. [ 937.230697] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.230880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.230920] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.231170] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.231316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.245153] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee in Status: IN_PROGRESS for 2s [ 937.393316] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.578362] env[70520]: INFO networking_nsxv3.common.synchronization [req-8044007c-b69d-419a-972f-83f713dd27c7 req-e2e64629-564e-4670-a8dd-3d7d2060a952 service nova] Enqueued Resource ID: 0775b802-20d8-4210-ad0d-b621a7b66c62 with Priority: HIGHEST for action security_group_rules [ 937.578362] env[70520]: INFO networking_nsxv3.common.synchronization [req-8044007c-b69d-419a-972f-83f713dd27c7 req-e2e64629-564e-4670-a8dd-3d7d2060a952 service nova] Enqueued Resource ID: 0775b802-20d8-4210-ad0d-b621a7b66c62 with Priority: HIGHEST for action security_group_members [ 937.578362] env[70520]: INFO networking_nsxv3.common.synchronization [req-8044007c-b69d-419a-972f-83f713dd27c7 req-e2e64629-564e-4670-a8dd-3d7d2060a952 service nova] Enqueued Resource ID: 52a5a97d-0b89-4670-a64e-15d625ce7af5 with Priority: HIGHEST for action port [ 937.578362] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0775b802-20d8-4210-ad0d-b621a7b66c62 with Priority: HIGHEST for action security_group_rules [ 937.578362] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0775b802-20d8-4210-ad0d-b621a7b66c62 with Priority: HIGHEST for action security_group_members [ 937.578362] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a5a97d-0b89-4670-a64e-15d625ce7af5 with Priority: HIGHEST for action port [ 937.578362] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0775b802-20d8-4210-ad0d-b621a7b66c62 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.578362] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.578362] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.578362] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.578362] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0775b802-20d8-4210-ad0d-b621a7b66c62',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.580697] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-0775b802-20d8-4210-ad0d-b621a7b66c62 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.580869] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.580911] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.581133] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.581290] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.581410] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.581481] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.581648] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.581738] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.581836] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0775b802-20d8-4210-ad0d-b621a7b66c62',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.582699] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-52a5a97d-0b89-4670-a64e-15d625ce7af5 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.582842] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52a5a97d-0b89-4670-a64e-15d625ce7af5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.583059] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52a5a97d-0b89-4670-a64e-15d625ce7af5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.583461] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52a5a97d-0b89-4670-a64e-15d625ce7af5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.583581] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52a5a97d-0b89-4670-a64e-15d625ce7af5',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.898267] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.085628] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0775b802-20d8-4210-ad0d-b621a7b66c62',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.086819] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-0775b802-20d8-4210-ad0d-b621a7b66c62 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.086957] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.087710] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52a5a97d-0b89-4670-a64e-15d625ce7af5 with status ACTIVE [ 938.087710] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.087710] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.087710] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.087887] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.087887] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.094020] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.094020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.094020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.094020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.094020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.094020] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.094020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.094020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.094020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.094020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.094020] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52a5a97d-0b89-4670-a64e-15d625ce7af5 is going to be updated. [ 938.115718] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.115826] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.115876] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.116085] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.116214] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.116895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52a5a97d-0b89-4670-a64e-15d625ce7af5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.402260] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.402260] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.402260] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.402260] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.402260] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.402260] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 is going to be updated. [ 938.434061] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.434061] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.434061] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.434061] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.434385] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.446874] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: IN_PROGRESS for 2s [ 938.592839] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0775b802-20d8-4210-ad0d-b621a7b66c62',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.097520] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.097838] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.097838] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.099194] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.099194] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.099194] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0775b802-20d8-4210-ad0d-b621a7b66c62 is going to be created. [ 939.123917] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.124906] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.125739] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.125739] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.125739] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.135897] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0775b802-20d8-4210-ad0d-b621a7b66c62 in Status: UNINITIALIZED for 2s [ 939.255459] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee in Status: SUCCESS [ 939.255557] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee deletion is rescheduled due to dependency. [ 939.255637] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.409874] env[70520]: INFO networking_nsxv3.common.synchronization [req-9b4723b8-cab6-402d-a2d9-a67fcb2edeef req-9a958c59-4f66-488c-85a5-5d19a11093a7 tempest-ServersV294TestFqdnHostnames-201987379 tempest-ServersV294TestFqdnHostnames-201987379-project-member] Enqueued Resource ID: 858fdcda-30cd-409f-85f7-656e8a82042b with Priority: HIGHEST for action security_group_members [ 939.410528] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858fdcda-30cd-409f-85f7-656e8a82042b with Priority: HIGHEST for action security_group_members [ 939.410853] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-858fdcda-30cd-409f-85f7-656e8a82042b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.411007] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.411190] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.411930] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.411930] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.411930] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.411930] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.412141] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.412141] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.412227] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('858fdcda-30cd-409f-85f7-656e8a82042b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.914389] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.914582] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.914650] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.914873] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.915000] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.915165] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.915276] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.915319] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.915662] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.915766] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.915872] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 858fdcda-30cd-409f-85f7-656e8a82042b already deleted. [ 939.915957] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.977184] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-851 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.977184] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-851" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.977321] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-851" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.978084] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-851" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.978084] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.978084] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.978311] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.978427] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.978572] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.978808] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 939.978971] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 939.980981] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 939.980981] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 939.980981] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 939.980981] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 939.980981] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 940.004279] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 940.004536] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 940.004723] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 940.004911] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-851" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.005306] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-818b2240-51e3-4490-a02b-646280a30260 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.005507] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-818b2240-51e3-4490-a02b-646280a30260" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.005646] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-818b2240-51e3-4490-a02b-646280a30260" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.006057] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-818b2240-51e3-4490-a02b-646280a30260" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.006242] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('818b2240-51e3-4490-a02b-646280a30260',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.456912] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: SUCCESS [ 940.457184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.457328] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.458033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.458033] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.458033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.458033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.458317] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.458317] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.458317] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.458317] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.508440] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.508653] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.508837] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.509374] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.509374] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.509504] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 818b2240-51e3-4490-a02b-646280a30260 not found, creating... [ 940.509858] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.510062] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.510257] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.510433] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.510580] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.510876] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.511046] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.511168] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.511382] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.511519] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.511666] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 818b2240-51e3-4490-a02b-646280a30260 is going to be created. [ 940.537818] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.537818] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.537818] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.538106] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.538156] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.538400] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-818b2240-51e3-4490-a02b-646280a30260" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.963636] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.963801] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.963895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.964150] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.964319] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.964425] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.964487] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.964631] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.964774] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.964875] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.965052] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.965146] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.965204] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.965344] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.965481] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.965575] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.965628] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.965765] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.965837] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.965913] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.965997] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.148653] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0775b802-20d8-4210-ad0d-b621a7b66c62 in Status: SUCCESS [ 941.148919] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.149312] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.149413] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.149683] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.149825] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.149903] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.150120] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.150213] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.150324] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.150437] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0775b802-20d8-4210-ad0d-b621a7b66c62',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.470827] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b22ab11-3a43-4e3c-a9ac-8ee49b487341: rpc.has_security_group_logging(os_id): False [ 941.491920] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.492352] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.492437] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.492653] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.514660] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.514994] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.515141] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.515209] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.515415] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.515497] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.515683] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.515778] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.515841] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.515981] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.516071] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.516243] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.516335] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.516396] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.519862] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.519862] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.519862] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 is going to be updated. [ 941.533129] env[70520]: INFO networking_nsxv3.common.synchronization [req-9b4723b8-cab6-402d-a2d9-a67fcb2edeef req-46eecde8-4b5b-4f63-944b-801eec587c7e service nova] Enqueued Resource ID: 858fdcda-30cd-409f-85f7-656e8a82042b with Priority: HIGHEST for action security_group_rules [ 941.533326] env[70520]: INFO networking_nsxv3.common.synchronization [req-9b4723b8-cab6-402d-a2d9-a67fcb2edeef req-46eecde8-4b5b-4f63-944b-801eec587c7e service nova] Enqueued Resource ID: 858fdcda-30cd-409f-85f7-656e8a82042b with Priority: HIGHEST for action security_group_members [ 941.533466] env[70520]: INFO networking_nsxv3.common.synchronization [req-9b4723b8-cab6-402d-a2d9-a67fcb2edeef req-46eecde8-4b5b-4f63-944b-801eec587c7e service nova] Enqueued Resource ID: 818b2240-51e3-4490-a02b-646280a30260 with Priority: HIGHEST for action port [ 941.533705] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858fdcda-30cd-409f-85f7-656e8a82042b with Priority: HIGHEST for action security_group_rules [ 941.533833] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858fdcda-30cd-409f-85f7-656e8a82042b with Priority: HIGHEST for action security_group_members [ 941.533923] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 818b2240-51e3-4490-a02b-646280a30260 with Priority: HIGHEST for action port [ 941.534545] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-858fdcda-30cd-409f-85f7-656e8a82042b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.534677] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.534773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.534933] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.535024] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('858fdcda-30cd-409f-85f7-656e8a82042b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.535838] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-858fdcda-30cd-409f-85f7-656e8a82042b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.535952] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.536028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.536200] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.536345] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.536458] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.539663] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.539663] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.539663] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.539663] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('858fdcda-30cd-409f-85f7-656e8a82042b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.539663] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-818b2240-51e3-4490-a02b-646280a30260 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.539663] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-818b2240-51e3-4490-a02b-646280a30260" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.539663] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-818b2240-51e3-4490-a02b-646280a30260" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.539663] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-818b2240-51e3-4490-a02b-646280a30260" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.539663] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('818b2240-51e3-4490-a02b-646280a30260',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.595209] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.595209] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.595209] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.595209] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.595209] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.612605] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: IN_PROGRESS for 2s [ 941.652613] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0775b802-20d8-4210-ad0d-b621a7b66c62',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.039948] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-858fdcda-30cd-409f-85f7-656e8a82042b taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.040149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.040377] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('858fdcda-30cd-409f-85f7-656e8a82042b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.041306] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 818b2240-51e3-4490-a02b-646280a30260 with status ACTIVE [ 942.041532] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.041653] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.041721] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.041930] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.042033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.042205] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.042292] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.042352] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.042503] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.042578] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.042756] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.042847] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.042903] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.043105] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.043226] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.043261] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 818b2240-51e3-4490-a02b-646280a30260 is going to be updated. [ 942.066068] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.066380] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.066584] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.066907] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.067140] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.067377] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-818b2240-51e3-4490-a02b-646280a30260" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.155263] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0775b802-20d8-4210-ad0d-b621a7b66c62: rpc.has_security_group_logging(os_id): False [ 942.186048] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.186304] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.186304] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.186822] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.186923] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.187260] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.187372] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.187541] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.187797] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.187876] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.187973] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0775b802-20d8-4210-ad0d-b621a7b66c62 is going to be created. [ 942.366304] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.366492] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.366560] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.366824] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.367022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.386316] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0775b802-20d8-4210-ad0d-b621a7b66c62 in Status: IN_PROGRESS for 2s [ 942.545926] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('858fdcda-30cd-409f-85f7-656e8a82042b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.049725] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.049940] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.050017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.050251] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.050419] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.050465] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 858fdcda-30cd-409f-85f7-656e8a82042b is going to be created. [ 943.080355] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.080355] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.080355] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.080355] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.080355] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.091551] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 858fdcda-30cd-409f-85f7-656e8a82042b in Status: UNINITIALIZED for 2s [ 943.652069] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: SUCCESS [ 943.652525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.325924] env[70520]: INFO networking_nsxv3.common.synchronization [req-5e1ef632-790e-4c91-990a-845444b459ae req-71b78e26-8770-48ab-8305-121bb0b3992d tempest-ListImageFiltersTestJSON-785679465 tempest-ListImageFiltersTestJSON-785679465-project-member] Enqueued Resource ID: ada31481-82b9-4792-af47-296d5fe27a9f with Priority: HIGHEST for action security_group_members [ 944.326695] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ada31481-82b9-4792-af47-296d5fe27a9f with Priority: HIGHEST for action security_group_members [ 944.329037] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada31481-82b9-4792-af47-296d5fe27a9f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.329037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.329037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.329037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.329037] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.329037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.329037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.329037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.329037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.329037] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ada31481-82b9-4792-af47-296d5fe27a9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.403023] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0775b802-20d8-4210-ad0d-b621a7b66c62 in Status: SUCCESS [ 944.403023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.654409] env[70520]: INFO networking_nsxv3.common.synchronization [req-d7d40d30-f4c2-463b-8e76-c03b2e276ecc req-d12e1c47-c30d-4492-9568-5f2969a99b5d tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_members [ 944.654409] env[70520]: INFO networking_nsxv3.common.synchronization [req-d7d40d30-f4c2-463b-8e76-c03b2e276ecc req-d12e1c47-c30d-4492-9568-5f2969a99b5d tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 with Priority: HIGHEST for action security_group_members [ 944.654409] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_members [ 944.654409] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 with Priority: HIGHEST for action security_group_members [ 944.654409] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.654409] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.654409] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.654409] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.655535] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.656523] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.656729] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.657023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.657216] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.657417] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.658867] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-45614c93-85f6-4dc6-92a5-f7ed3744cf81 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.661018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.661018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.661018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.661018] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.661018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.661018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.661018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.661018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.661018] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45614c93-85f6-4dc6-92a5-f7ed3744cf81',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.700039] env[70520]: INFO networking_nsxv3.common.synchronization [req-d7d40d30-f4c2-463b-8e76-c03b2e276ecc req-d12e1c47-c30d-4492-9568-5f2969a99b5d tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 with Priority: HIGHEST for action security_group_rules [ 944.700039] env[70520]: INFO networking_nsxv3.common.synchronization [req-d7d40d30-f4c2-463b-8e76-c03b2e276ecc req-d12e1c47-c30d-4492-9568-5f2969a99b5d tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 with Priority: HIGHEST for action security_group_members [ 944.700039] env[70520]: INFO networking_nsxv3.common.synchronization [req-d7d40d30-f4c2-463b-8e76-c03b2e276ecc req-d12e1c47-c30d-4492-9568-5f2969a99b5d tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_rules [ 944.700039] env[70520]: INFO networking_nsxv3.common.synchronization [req-d7d40d30-f4c2-463b-8e76-c03b2e276ecc req-d12e1c47-c30d-4492-9568-5f2969a99b5d tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_members [ 944.700039] env[70520]: INFO networking_nsxv3.common.synchronization [req-d7d40d30-f4c2-463b-8e76-c03b2e276ecc req-d12e1c47-c30d-4492-9568-5f2969a99b5d tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 41fe9c56-a523-478e-bb8e-468c8411c6f1 with Priority: HIGHEST for action port [ 944.700039] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 with Priority: HIGHEST for action security_group_rules [ 944.700039] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_rules [ 944.700807] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41fe9c56-a523-478e-bb8e-468c8411c6f1 with Priority: HIGHEST for action port [ 944.701103] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 with Priority: HIGHEST for action security_group_members [ 944.701318] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_members [ 944.701705] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45614c93-85f6-4dc6-92a5-f7ed3744cf81 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.701955] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.702139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.702564] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.702783] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45614c93-85f6-4dc6-92a5-f7ed3744cf81',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.704166] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.704432] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.705016] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.705016] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.705016] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.707509] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-41fe9c56-a523-478e-bb8e-468c8411c6f1 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.707509] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41fe9c56-a523-478e-bb8e-468c8411c6f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.707509] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41fe9c56-a523-478e-bb8e-468c8411c6f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.707509] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41fe9c56-a523-478e-bb8e-468c8411c6f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.707509] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41fe9c56-a523-478e-bb8e-468c8411c6f1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.709588] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-45614c93-85f6-4dc6-92a5-f7ed3744cf81 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.710382] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.710382] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.710382] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.832052] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.833196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.833196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.833196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.833196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.833196] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.833196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.833196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.833495] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.833495] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.833557] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ada31481-82b9-4792-af47-296d5fe27a9f is going to be updated. [ 944.873756] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.873979] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.874059] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.874499] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.874696] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.886682] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ada31481-82b9-4792-af47-296d5fe27a9f in Status: IN_PROGRESS for 2s [ 945.104082] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 858fdcda-30cd-409f-85f7-656e8a82042b in Status: SUCCESS [ 945.104368] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.104490] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.104698] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.104901] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.105029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.105096] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.105251] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.105331] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.105447] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.105512] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('858fdcda-30cd-409f-85f7-656e8a82042b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.162893] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.164416] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45614c93-85f6-4dc6-92a5-f7ed3744cf81',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.207584] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.207842] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.213043] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 41fe9c56-a523-478e-bb8e-468c8411c6f1 with status ACTIVE [ 945.213043] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.213043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.213043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.213043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.213043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.213043] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.213043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.213043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.213043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.213043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.213043] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.213043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.213043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.213043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.213043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.213043] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 41fe9c56-a523-478e-bb8e-468c8411c6f1 is going to be updated. [ 945.214308] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-45614c93-85f6-4dc6-92a5-f7ed3744cf81 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.214417] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.239231] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.239415] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.239499] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.239760] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.239943] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.240131] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41fe9c56-a523-478e-bb8e-468c8411c6f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.608207] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('858fdcda-30cd-409f-85f7-656e8a82042b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.667393] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.668522] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45614c93-85f6-4dc6-92a5-f7ed3744cf81',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.111926] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 858fdcda-30cd-409f-85f7-656e8a82042b: rpc.has_security_group_logging(os_id): False [ 946.134365] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.134533] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.134598] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.134804] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.134893] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.135164] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.135268] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.135333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.135483] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.135561] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.135646] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 858fdcda-30cd-409f-85f7-656e8a82042b is going to be created. [ 946.170878] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.171137] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.171204] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.171972] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.171972] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.171972] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 is going to be updated. [ 946.172969] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.173098] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.173164] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.173326] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.173474] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.173589] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 is going to be created. [ 946.201130] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.201130] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.201130] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.201130] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.201130] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.213571] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.214362] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.214571] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.214858] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.215145] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.217459] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 in Status: UNINITIALIZED for 2s [ 946.219974] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.220330] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.220486] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.220765] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.220979] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.229209] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: IN_PROGRESS for 2s [ 946.230765] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 858fdcda-30cd-409f-85f7-656e8a82042b in Status: IN_PROGRESS for 2s [ 946.386113] env[70520]: INFO networking_nsxv3.common.synchronization [req-ef67b8d1-adb5-45c8-8076-c417ae17cc0c req-a2354c15-c00e-4909-a8cc-f3cf14d8968d tempest-ServersNegativeTestMultiTenantJSON-601382293 tempest-ServersNegativeTestMultiTenantJSON-601382293-project-member] Enqueued Resource ID: d77f36dd-6e19-41b5-98f9-4bafae832400 with Priority: HIGHEST for action security_group_members [ 946.386113] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d77f36dd-6e19-41b5-98f9-4bafae832400 with Priority: HIGHEST for action security_group_members [ 946.386113] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d77f36dd-6e19-41b5-98f9-4bafae832400 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.386113] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.386113] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.386646] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.386646] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.386646] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.392037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.396023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.396023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.396023] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d77f36dd-6e19-41b5-98f9-4bafae832400',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.879185] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-588 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.879493] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-588" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.879531] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-588" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.880226] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-588" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.880379] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.880553] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.880695] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.884152] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.885958] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.885958] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 946.885958] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 946.885958] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 946.885958] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 946.885958] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 946.885958] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 946.885958] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 946.898013] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ada31481-82b9-4792-af47-296d5fe27a9f in Status: SUCCESS [ 946.898218] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ada31481-82b9-4792-af47-296d5fe27a9f deletion is rescheduled due to dependency. [ 946.898341] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.898692] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.898822] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.898876] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.899094] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.899174] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.899365] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.899461] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.899550] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.899688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.899766] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.899877] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d77f36dd-6e19-41b5-98f9-4bafae832400 already deleted. [ 946.899877] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.910156] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 946.910156] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 946.910156] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 946.910156] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-588" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.910156] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-610f9224-2b1b-495d-91d4-307a653fd4c6 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.910156] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-610f9224-2b1b-495d-91d4-307a653fd4c6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.910156] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-610f9224-2b1b-495d-91d4-307a653fd4c6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.910156] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-610f9224-2b1b-495d-91d4-307a653fd4c6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.910156] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('610f9224-2b1b-495d-91d4-307a653fd4c6',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.414233] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.414543] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.414729] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.415035] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.415224] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.415393] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 610f9224-2b1b-495d-91d4-307a653fd4c6 not found, creating... [ 947.415668] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.415844] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.415964] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.416207] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.416350] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.417879] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.418174] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.418390] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.418694] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.418946] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.419184] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 610f9224-2b1b-495d-91d4-307a653fd4c6 is going to be created. [ 947.442460] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.442611] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.442725] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.443045] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.443469] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.443568] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-610f9224-2b1b-495d-91d4-307a653fd4c6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.185262] env[70520]: INFO networking_nsxv3.common.synchronization [req-ef67b8d1-adb5-45c8-8076-c417ae17cc0c req-0fce1b16-a050-484a-b647-754ee91e61f4 service nova] Enqueued Resource ID: d77f36dd-6e19-41b5-98f9-4bafae832400 with Priority: HIGHEST for action security_group_rules [ 948.185517] env[70520]: INFO networking_nsxv3.common.synchronization [req-ef67b8d1-adb5-45c8-8076-c417ae17cc0c req-0fce1b16-a050-484a-b647-754ee91e61f4 service nova] Enqueued Resource ID: d77f36dd-6e19-41b5-98f9-4bafae832400 with Priority: HIGHEST for action security_group_members [ 948.185517] env[70520]: INFO networking_nsxv3.common.synchronization [req-ef67b8d1-adb5-45c8-8076-c417ae17cc0c req-0fce1b16-a050-484a-b647-754ee91e61f4 service nova] Enqueued Resource ID: 610f9224-2b1b-495d-91d4-307a653fd4c6 with Priority: HIGHEST for action port [ 948.185957] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d77f36dd-6e19-41b5-98f9-4bafae832400 with Priority: HIGHEST for action security_group_rules [ 948.186096] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d77f36dd-6e19-41b5-98f9-4bafae832400 with Priority: HIGHEST for action security_group_members [ 948.186189] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 610f9224-2b1b-495d-91d4-307a653fd4c6 with Priority: HIGHEST for action port [ 948.186460] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d77f36dd-6e19-41b5-98f9-4bafae832400 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.186613] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.186679] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.186931] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.187064] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d77f36dd-6e19-41b5-98f9-4bafae832400',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.188358] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d77f36dd-6e19-41b5-98f9-4bafae832400 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.188477] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.188919] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.188919] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.188919] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.192226] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.192311] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.192477] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.195020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.195020] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d77f36dd-6e19-41b5-98f9-4bafae832400',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.195020] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-610f9224-2b1b-495d-91d4-307a653fd4c6 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.195020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-610f9224-2b1b-495d-91d4-307a653fd4c6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.195020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-610f9224-2b1b-495d-91d4-307a653fd4c6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.195020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-610f9224-2b1b-495d-91d4-307a653fd4c6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.195020] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('610f9224-2b1b-495d-91d4-307a653fd4c6',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.230394] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 in Status: SUCCESS [ 948.230535] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.231602] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.231830] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.232017] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.232135] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.232200] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.232348] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.232431] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.232524] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45614c93-85f6-4dc6-92a5-f7ed3744cf81',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.242437] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: SUCCESS [ 948.242592] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.242732] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.242945] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.243146] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.243260] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.243325] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.243472] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.243552] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.243642] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.245128] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 858fdcda-30cd-409f-85f7-656e8a82042b in Status: SUCCESS [ 948.245610] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.696449] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d77f36dd-6e19-41b5-98f9-4bafae832400 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.696449] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.696449] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d77f36dd-6e19-41b5-98f9-4bafae832400',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.701300] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 610f9224-2b1b-495d-91d4-307a653fd4c6 with status ACTIVE [ 948.701541] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.701726] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.701837] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.702286] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.702362] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.702670] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.702763] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.702905] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.703055] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.703145] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.703338] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.703439] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.703493] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.703643] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.703746] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.703798] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 610f9224-2b1b-495d-91d4-307a653fd4c6 is going to be updated. [ 948.727708] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.727812] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.727912] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.728103] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.728244] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.728400] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-610f9224-2b1b-495d-91d4-307a653fd4c6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.736791] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45614c93-85f6-4dc6-92a5-f7ed3744cf81',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.747659] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.057567] env[70520]: INFO networking_nsxv3.common.synchronization [req-abc4bbb2-8061-48cd-b44e-18daf96943d7 req-5e4dacf0-55ae-496a-8c5c-3b16bd8ac960 tempest-ServersAdminTestJSON-2063681355 tempest-ServersAdminTestJSON-2063681355-project-member] Enqueued Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_members [ 949.058749] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_members [ 949.058749] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.058749] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.058749] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.059014] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.061928] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.061928] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.061928] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.061928] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.061928] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.061928] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.206689] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d77f36dd-6e19-41b5-98f9-4bafae832400',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.244448] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45614c93-85f6-4dc6-92a5-f7ed3744cf81',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.249797] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.506762] env[70520]: INFO networking_nsxv3.common.synchronization [req-eb5a6d31-7dc4-4625-99e0-f7bf170a61b3 req-610c377f-e441-4bfb-8d63-89b42aa718bc tempest-ImagesOneServerNegativeTestJSON-1115954637 tempest-ImagesOneServerNegativeTestJSON-1115954637-project-member] Enqueued Resource ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad with Priority: HIGHEST for action security_group_members [ 949.507406] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad with Priority: HIGHEST for action security_group_members [ 949.507764] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc3c352-f711-4ecc-9064-0883727ce3ad taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.508871] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.508871] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.508871] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.508871] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.508871] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.510748] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.510748] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.510748] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.510748] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cc3c352-f711-4ecc-9064-0883727ce3ad',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.563021] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.709473] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.709689] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.709689] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.709916] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.710017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.710125] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d77f36dd-6e19-41b5-98f9-4bafae832400 is going to be created. [ 949.746974] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.747224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.747224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.747397] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.747657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.749021] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.749446] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.749534] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.749719] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.749804] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.749902] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 is going to be updated. [ 949.751434] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.751638] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.751638] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.751799] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.751881] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.751978] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 is going to be updated. [ 949.763709] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d77f36dd-6e19-41b5-98f9-4bafae832400 in Status: UNINITIALIZED for 2s [ 949.797036] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.797036] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.797036] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.797036] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.797036] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.798763] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.799080] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.799080] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.801028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.801028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.812227] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: IN_PROGRESS for 2s [ 949.813113] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 in Status: IN_PROGRESS for 2s [ 949.885825] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-318 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.886630] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-318" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.886630] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-318" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.886892] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-318" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.887195] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.887370] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.887590] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.888230] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.888230] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.888560] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 949.888560] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 949.888560] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 949.888754] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 949.888819] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 949.888946] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 949.889708] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 949.910830] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 949.911012] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 949.911190] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 949.911417] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-318" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.911687] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-6c6cb29f-2eed-4298-a29b-228f56b8156c taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.911866] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-6c6cb29f-2eed-4298-a29b-228f56b8156c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.911985] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-6c6cb29f-2eed-4298-a29b-228f56b8156c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.912363] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-6c6cb29f-2eed-4298-a29b-228f56b8156c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.913978] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c6cb29f-2eed-4298-a29b-228f56b8156c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.012625] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.012841] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.012841] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.013230] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.013334] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.013551] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.013649] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.013738] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.013878] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.013954] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.014054] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad is going to be updated. [ 950.049501] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.049674] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.049724] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.050018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.050453] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.061609] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad in Status: IN_PROGRESS for 2s [ 950.067802] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.371737] env[70520]: INFO networking_nsxv3.common.synchronization [req-781c4e04-bfc9-484a-b8ad-6bc5d3356e10 req-04257fcd-391b-4c4b-84ae-8261c2b2fe9c tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 703698ab-75f7-4b24-87e2-1dc2846b3180 with Priority: HIGHEST for action security_group_members [ 950.371737] env[70520]: INFO networking_nsxv3.common.synchronization [req-781c4e04-bfc9-484a-b8ad-6bc5d3356e10 req-04257fcd-391b-4c4b-84ae-8261c2b2fe9c tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_members [ 950.371737] env[70520]: INFO networking_nsxv3.common.synchronization [req-781c4e04-bfc9-484a-b8ad-6bc5d3356e10 req-04257fcd-391b-4c4b-84ae-8261c2b2fe9c tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 with Priority: HIGHEST for action security_group_members [ 950.371737] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 703698ab-75f7-4b24-87e2-1dc2846b3180 with Priority: HIGHEST for action security_group_members [ 950.371737] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_members [ 950.371737] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 with Priority: HIGHEST for action security_group_members [ 950.374168] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-703698ab-75f7-4b24-87e2-1dc2846b3180 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.374168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-703698ab-75f7-4b24-87e2-1dc2846b3180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.374168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-703698ab-75f7-4b24-87e2-1dc2846b3180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.375033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-703698ab-75f7-4b24-87e2-1dc2846b3180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.375033] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.375033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.375033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.375256] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.375286] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.375375] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('703698ab-75f7-4b24-87e2-1dc2846b3180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.378209] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.378360] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.379025] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-45614c93-85f6-4dc6-92a5-f7ed3744cf81 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.379025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.415075] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.415508] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.415508] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.415793] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.415972] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.416174] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 6c6cb29f-2eed-4298-a29b-228f56b8156c not found, creating... [ 950.416453] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.417215] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.417357] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.417792] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.417825] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.418755] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.418968] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.419142] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.419712] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.419861] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.420023] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 6c6cb29f-2eed-4298-a29b-228f56b8156c is going to be created. [ 950.424458] env[70520]: INFO networking_nsxv3.common.synchronization [req-781c4e04-bfc9-484a-b8ad-6bc5d3356e10 req-04257fcd-391b-4c4b-84ae-8261c2b2fe9c tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 with Priority: HIGHEST for action security_group_rules [ 950.425974] env[70520]: INFO networking_nsxv3.common.synchronization [req-781c4e04-bfc9-484a-b8ad-6bc5d3356e10 req-04257fcd-391b-4c4b-84ae-8261c2b2fe9c tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 with Priority: HIGHEST for action security_group_members [ 950.425974] env[70520]: INFO networking_nsxv3.common.synchronization [req-781c4e04-bfc9-484a-b8ad-6bc5d3356e10 req-04257fcd-391b-4c4b-84ae-8261c2b2fe9c tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 703698ab-75f7-4b24-87e2-1dc2846b3180 with Priority: HIGHEST for action security_group_rules [ 950.425974] env[70520]: INFO networking_nsxv3.common.synchronization [req-781c4e04-bfc9-484a-b8ad-6bc5d3356e10 req-04257fcd-391b-4c4b-84ae-8261c2b2fe9c tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 703698ab-75f7-4b24-87e2-1dc2846b3180 with Priority: HIGHEST for action security_group_members [ 950.425974] env[70520]: INFO networking_nsxv3.common.synchronization [req-781c4e04-bfc9-484a-b8ad-6bc5d3356e10 req-04257fcd-391b-4c4b-84ae-8261c2b2fe9c tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_rules [ 950.425974] env[70520]: INFO networking_nsxv3.common.synchronization [req-781c4e04-bfc9-484a-b8ad-6bc5d3356e10 req-04257fcd-391b-4c4b-84ae-8261c2b2fe9c tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_members [ 950.425974] env[70520]: INFO networking_nsxv3.common.synchronization [req-781c4e04-bfc9-484a-b8ad-6bc5d3356e10 req-04257fcd-391b-4c4b-84ae-8261c2b2fe9c tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 41fe9c56-a523-478e-bb8e-468c8411c6f1 with Priority: HIGHEST for action port [ 950.426274] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 with Priority: HIGHEST for action security_group_rules [ 950.426508] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 703698ab-75f7-4b24-87e2-1dc2846b3180 with Priority: HIGHEST for action security_group_rules [ 950.426508] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_members [ 950.426588] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41fe9c56-a523-478e-bb8e-468c8411c6f1 with Priority: HIGHEST for action port [ 950.426683] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_rules [ 950.426745] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 with Priority: HIGHEST for action security_group_members [ 950.426836] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 703698ab-75f7-4b24-87e2-1dc2846b3180 with Priority: HIGHEST for action security_group_members [ 950.427277] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45614c93-85f6-4dc6-92a5-f7ed3744cf81 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.427387] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.427570] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-703698ab-75f7-4b24-87e2-1dc2846b3180 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.427668] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-703698ab-75f7-4b24-87e2-1dc2846b3180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.427728] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-703698ab-75f7-4b24-87e2-1dc2846b3180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.427944] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-703698ab-75f7-4b24-87e2-1dc2846b3180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.428652] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('703698ab-75f7-4b24-87e2-1dc2846b3180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.428849] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.428978] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.431506] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-41fe9c56-a523-478e-bb8e-468c8411c6f1 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.431506] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41fe9c56-a523-478e-bb8e-468c8411c6f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.431506] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41fe9c56-a523-478e-bb8e-468c8411c6f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.431506] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41fe9c56-a523-478e-bb8e-468c8411c6f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.431506] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41fe9c56-a523-478e-bb8e-468c8411c6f1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.431506] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.431506] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.431506] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-45614c93-85f6-4dc6-92a5-f7ed3744cf81 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.431506] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.432941] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-703698ab-75f7-4b24-87e2-1dc2846b3180 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.433082] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-703698ab-75f7-4b24-87e2-1dc2846b3180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.447110] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.447360] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.447493] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.447826] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.448076] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.448366] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-6c6cb29f-2eed-4298-a29b-228f56b8156c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.573599] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.575055] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.575055] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.575055] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.575055] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.575055] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 is going to be updated. [ 950.645902] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.647650] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.648694] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.648694] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.648694] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.663518] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: IN_PROGRESS for 2s [ 950.880406] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('703698ab-75f7-4b24-87e2-1dc2846b3180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.934878] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-703698ab-75f7-4b24-87e2-1dc2846b3180 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.935056] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-703698ab-75f7-4b24-87e2-1dc2846b3180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.935292] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 41fe9c56-a523-478e-bb8e-468c8411c6f1 with status ACTIVE [ 950.935550] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.935609] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.935691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.935944] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.936080] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.936357] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.936430] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.936472] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.937576] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.937576] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.937576] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.937576] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.937576] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.937576] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.937576] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.937576] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 41fe9c56-a523-478e-bb8e-468c8411c6f1 is going to be updated. [ 950.962479] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.962658] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.963031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.963214] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.963254] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.963502] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41fe9c56-a523-478e-bb8e-468c8411c6f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.384327] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('703698ab-75f7-4b24-87e2-1dc2846b3180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.492477] env[70520]: INFO networking_nsxv3.common.synchronization [req-abc4bbb2-8061-48cd-b44e-18daf96943d7 req-63d9b266-9819-48d0-bb32-e90838af06b9 service nova] Enqueued Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_rules [ 951.492675] env[70520]: INFO networking_nsxv3.common.synchronization [req-abc4bbb2-8061-48cd-b44e-18daf96943d7 req-63d9b266-9819-48d0-bb32-e90838af06b9 service nova] Enqueued Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_members [ 951.493031] env[70520]: INFO networking_nsxv3.common.synchronization [req-abc4bbb2-8061-48cd-b44e-18daf96943d7 req-63d9b266-9819-48d0-bb32-e90838af06b9 service nova] Enqueued Resource ID: 6c6cb29f-2eed-4298-a29b-228f56b8156c with Priority: HIGHEST for action port [ 951.493081] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_rules [ 951.493181] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_members [ 951.493272] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c6cb29f-2eed-4298-a29b-228f56b8156c with Priority: HIGHEST for action port [ 951.493903] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4e36438-996a-4d8f-adfb-5a87b2e7bd82 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.495315] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.495405] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.495696] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.495729] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.498018] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.498018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.498018] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c6cb29f-2eed-4298-a29b-228f56b8156c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.498018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c6cb29f-2eed-4298-a29b-228f56b8156c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.498018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c6cb29f-2eed-4298-a29b-228f56b8156c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.498351] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c6cb29f-2eed-4298-a29b-228f56b8156c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.498351] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c6cb29f-2eed-4298-a29b-228f56b8156c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.774102] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d77f36dd-6e19-41b5-98f9-4bafae832400 in Status: SUCCESS [ 951.774417] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.775502] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.775502] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.775502] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.775502] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.775660] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.775777] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.775902] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.779019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.779019] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d77f36dd-6e19-41b5-98f9-4bafae832400',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.824401] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 in Status: SUCCESS [ 951.824478] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.824633] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.824869] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.825100] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.825255] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.825302] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.825431] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.825531] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.825602] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.825697] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45614c93-85f6-4dc6-92a5-f7ed3744cf81',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.827871] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: SUCCESS [ 951.829743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.829743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.829743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.829743] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.829743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.829743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.829743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.829743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.829743] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45614c93-85f6-4dc6-92a5-f7ed3744cf81',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.831025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.831205] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.831375] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.831486] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.831544] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.831693] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.831772] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.831855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.831950] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.833327] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.833719] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.833901] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.834018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.834525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.834699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.834786] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.834877] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.887668] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.887895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.887980] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.888185] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.888311] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.888416] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 703698ab-75f7-4b24-87e2-1dc2846b3180 is going to be created. [ 951.915636] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.915636] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.915636] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.915891] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.915891] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.927325] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 703698ab-75f7-4b24-87e2-1dc2846b3180 in Status: UNINITIALIZED for 2s [ 951.999891] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c6cb29f-2eed-4298-a29b-228f56b8156c with status ACTIVE [ 952.000149] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.000314] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.000387] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.000610] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.000744] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.000940] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.001106] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.001162] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.001300] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.001378] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.001555] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.001652] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.001712] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.001841] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.001915] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.002049] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c6cb29f-2eed-4298-a29b-228f56b8156c is going to be updated. [ 952.004138] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.004383] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.029301] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.029869] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.029869] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.030595] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.032726] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.032726] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c6cb29f-2eed-4298-a29b-228f56b8156c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.082120] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad in Status: SUCCESS [ 952.082471] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad deletion is rescheduled due to dependency. [ 952.082686] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.279157] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d77f36dd-6e19-41b5-98f9-4bafae832400 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.281694] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.281795] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.282046] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.282216] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.282319] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.282491] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.282569] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.282649] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.282758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.282977] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d77f36dd-6e19-41b5-98f9-4bafae832400 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.283117] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.283117] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.283286] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.283429] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.283554] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.283612] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.283726] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.283800] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.283903] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.284019] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d77f36dd-6e19-41b5-98f9-4bafae832400',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.328387] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45614c93-85f6-4dc6-92a5-f7ed3744cf81',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.333738] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45614c93-85f6-4dc6-92a5-f7ed3744cf81',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.334918] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.335073] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.337595] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.675712] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: SUCCESS [ 952.675712] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.675712] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.676076] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.676132] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.676296] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.676397] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.677436] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.677436] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.677436] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.788340] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d77f36dd-6e19-41b5-98f9-4bafae832400: rpc.has_security_group_logging(os_id): False [ 952.822849] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.822849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.822849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.822849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.822849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.822849] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.822849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.822849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.822849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.822849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.822849] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.822849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.822849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.824351] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.824351] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.824351] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.824351] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.824351] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.824351] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.824351] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.824666] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d77f36dd-6e19-41b5-98f9-4bafae832400 is going to be created. [ 952.834281] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45614c93-85f6-4dc6-92a5-f7ed3744cf81: rpc.has_security_group_logging(os_id): False [ 952.837724] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45614c93-85f6-4dc6-92a5-f7ed3744cf81',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.840016] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.873026] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.873026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.873026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.873026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.873026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.873026] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.873026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.873026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.873026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.873026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.873026] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 is going to be created. [ 952.934356] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.934709] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.934709] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.934835] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.934991] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.951240] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.951416] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.951485] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.951782] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.952062] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.959949] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d77f36dd-6e19-41b5-98f9-4bafae832400 in Status: IN_PROGRESS for 2s [ 952.980470] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 in Status: IN_PROGRESS for 2s [ 953.180323] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.340556] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.340766] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.340848] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.341165] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.341271] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.341373] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 is going to be updated. [ 953.344039] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.344039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.344039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.344039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.344039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.344039] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 is going to be updated. [ 953.377891] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.378853] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.378853] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.379099] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.379250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.381461] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.381719] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.381719] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.381848] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.381976] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.395325] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: IN_PROGRESS for 2s [ 953.396176] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 in Status: IN_PROGRESS for 2s [ 953.436707] env[70520]: INFO networking_nsxv3.common.synchronization [req-3c49301e-5dba-45e8-9672-5339cbb8c213 req-fdfc7017-9594-4ba1-804c-8a2c91888aae tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 703698ab-75f7-4b24-87e2-1dc2846b3180 with Priority: HIGHEST for action security_group_members [ 953.436812] env[70520]: INFO networking_nsxv3.common.synchronization [req-3c49301e-5dba-45e8-9672-5339cbb8c213 req-fdfc7017-9594-4ba1-804c-8a2c91888aae tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_members [ 953.440031] env[70520]: INFO networking_nsxv3.common.synchronization [req-3c49301e-5dba-45e8-9672-5339cbb8c213 req-fdfc7017-9594-4ba1-804c-8a2c91888aae tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 with Priority: HIGHEST for action security_group_members [ 953.440031] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 703698ab-75f7-4b24-87e2-1dc2846b3180 with Priority: HIGHEST for action security_group_members [ 953.440031] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_members [ 953.440031] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 with Priority: HIGHEST for action security_group_members [ 953.440031] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-703698ab-75f7-4b24-87e2-1dc2846b3180 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.440031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-703698ab-75f7-4b24-87e2-1dc2846b3180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.440031] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.440031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.440031] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-45614c93-85f6-4dc6-92a5-f7ed3744cf81 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.440031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.687205] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.942365] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 703698ab-75f7-4b24-87e2-1dc2846b3180 in Status: SUCCESS [ 953.942365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-703698ab-75f7-4b24-87e2-1dc2846b3180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.942365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-703698ab-75f7-4b24-87e2-1dc2846b3180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.942365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-703698ab-75f7-4b24-87e2-1dc2846b3180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.942365] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.942365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.942365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.942365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.942365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.942365] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('703698ab-75f7-4b24-87e2-1dc2846b3180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.193859] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.195926] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.195926] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.196474] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.196664] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.196827] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 is going to be updated. [ 954.234423] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.236007] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.236099] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.236448] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.236692] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.257856] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: IN_PROGRESS for 2s [ 954.298251] env[70520]: INFO networking_nsxv3.common.synchronization [req-0d171907-ad9d-4902-be40-134e71a0ed19 req-6a26be89-4f13-424b-a28a-5efc0a5558d2 tempest-ServersTestFqdnHostnames-896096734 tempest-ServersTestFqdnHostnames-896096734-project-member] Enqueued Resource ID: 653491db-2944-4ea2-bef7-8e2800a4b41b with Priority: HIGHEST for action security_group_members [ 954.302018] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653491db-2944-4ea2-bef7-8e2800a4b41b with Priority: HIGHEST for action security_group_members [ 954.302018] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-653491db-2944-4ea2-bef7-8e2800a4b41b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.302018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653491db-2944-4ea2-bef7-8e2800a4b41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.302018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653491db-2944-4ea2-bef7-8e2800a4b41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.302018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653491db-2944-4ea2-bef7-8e2800a4b41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.302018] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.302018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.302018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.302018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.302018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.302018] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('653491db-2944-4ea2-bef7-8e2800a4b41b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.447937] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.449566] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.449566] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.449566] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.449566] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.449566] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.449566] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.449566] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.449566] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.449566] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.449566] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 703698ab-75f7-4b24-87e2-1dc2846b3180 is going to be deleted. [ 954.483356] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.483521] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.483592] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.483808] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.483899] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.483996] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-703698ab-75f7-4b24-87e2-1dc2846b3180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.484227] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-703698ab-75f7-4b24-87e2-1dc2846b3180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.484447] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-703698ab-75f7-4b24-87e2-1dc2846b3180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.484636] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.484821] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.484821] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.485030] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.485144] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.485270] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('703698ab-75f7-4b24-87e2-1dc2846b3180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.802502] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.802914] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.802914] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.803480] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.839946] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.840353] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.840486] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.840553] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.840780] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.840870] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.840960] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 653491db-2944-4ea2-bef7-8e2800a4b41b is going to be updated. [ 954.885666] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.885666] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.885666] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.885666] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.885666] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.896317] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653491db-2944-4ea2-bef7-8e2800a4b41b in Status: IN_PROGRESS for 2s [ 954.974027] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d77f36dd-6e19-41b5-98f9-4bafae832400 in Status: SUCCESS [ 954.974393] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.988285] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.988420] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.988469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.988690] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.988788] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.988995] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.989135] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.989172] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.989857] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.989857] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.989857] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 703698ab-75f7-4b24-87e2-1dc2846b3180 already deleted. [ 954.989857] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-703698ab-75f7-4b24-87e2-1dc2846b3180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.989857] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('703698ab-75f7-4b24-87e2-1dc2846b3180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.990599] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-703698ab-75f7-4b24-87e2-1dc2846b3180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.991175] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-703698ab-75f7-4b24-87e2-1dc2846b3180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.991175] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.991175] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.991175] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.991394] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.991394] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.992405] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('703698ab-75f7-4b24-87e2-1dc2846b3180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.994887] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 in Status: SUCCESS [ 954.994887] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.994887] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.994887] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.994887] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45614c93-85f6-4dc6-92a5-f7ed3744cf81',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.407805] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 in Status: SUCCESS [ 955.407805] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.407805] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.408048] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.408645] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.408645] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.408645] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.408645] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.408645] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.408922] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45614c93-85f6-4dc6-92a5-f7ed3744cf81',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.410334] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: SUCCESS [ 955.410575] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.410753] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.410922] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.411100] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.411212] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.411265] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.411394] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.411469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.411893] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.493596] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('703698ab-75f7-4b24-87e2-1dc2846b3180',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.497449] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.497741] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.497872] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.498205] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.498326] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.498638] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.498747] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.498817] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.499035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.499105] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.499213] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 703698ab-75f7-4b24-87e2-1dc2846b3180 already deleted. [ 955.499356] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-703698ab-75f7-4b24-87e2-1dc2846b3180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.519347] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.519596] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.519596] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.519771] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.519858] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.519957] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 is going to be deleted. [ 955.574023] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.574023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.574375] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.574375] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.574470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.576639] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.913542] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.913844] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.913844] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.913992] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.914102] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.914328] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.914457] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.914567] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.914677] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.914755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.914841] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 is going to be deleted. [ 955.915841] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.947453] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.947672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.947727] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.947935] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.948056] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.948233] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.948441] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.948917] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.949098] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.949212] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.950029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.950203] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.950286] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.950384] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45614c93-85f6-4dc6-92a5-f7ed3744cf81',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.998268] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 703698ab-75f7-4b24-87e2-1dc2846b3180: rpc.has_security_group_logging(os_id): False [ 956.018548] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.018826] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.019093] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.019353] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.019449] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.019689] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.019817] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.019904] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.020159] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.020246] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.020342] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 703698ab-75f7-4b24-87e2-1dc2846b3180 is going to be created. [ 956.045274] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/703698ab-75f7-4b24-87e2-1dc2846b3180], does not exist path=[/infra/domains/default/groups/703698ab-75f7-4b24-87e2-1dc2846b3180]."\n}' [ 956.045564] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 703698ab-75f7-4b24-87e2-1dc2846b3180 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/703698ab-75f7-4b24-87e2-1dc2846b3180 [ 956.045695] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 956.086856] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.087060] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.087129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.087377] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.090014] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.090014] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.090014] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.090014] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.090014] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.090014] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.090014] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.090014] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.090014] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.090014] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.090014] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.090014] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 703698ab-75f7-4b24-87e2-1dc2846b3180 is going to be created. [ 956.109961] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/703698ab-75f7-4b24-87e2-1dc2846b3180], does not exist path=[/infra/domains/default/groups/703698ab-75f7-4b24-87e2-1dc2846b3180]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/703698ab-75f7-4b24-87e2-1dc2846b3180 [ 956.110146] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-703698ab-75f7-4b24-87e2-1dc2846b3180" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.110394] env[70520]: Traceback (most recent call last): [ 956.110444] env[70520]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 956.110444] env[70520]: return func(*args, **kwargs) [ 956.110444] env[70520]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 956.110444] env[70520]: res.raise_for_status() [ 956.110444] env[70520]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 956.110444] env[70520]: raise HTTPError(http_error_msg, response=self) [ 956.110444] env[70520]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/703698ab-75f7-4b24-87e2-1dc2846b3180 [ 956.110444] env[70520]: During handling of the above exception, another exception occurred: [ 956.110444] env[70520]: Traceback (most recent call last): [ 956.110444] env[70520]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 956.110444] env[70520]: listener.cb(fileno) [ 956.110444] env[70520]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 956.110444] env[70520]: result = function(*args, **kwargs) [ 956.110444] env[70520]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 956.110444] env[70520]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 956.110444] env[70520]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 956.110444] env[70520]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 956.111624] env[70520]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 956.111624] env[70520]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 956.111624] env[70520]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 956.111624] env[70520]: res.raise_for_status() [ 956.111624] env[70520]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 956.111624] env[70520]: raise HTTPError(http_error_msg, response=self) [ 956.111624] env[70520]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/703698ab-75f7-4b24-87e2-1dc2846b3180 [ 956.111624] env[70520]: Removing descriptor: 23 [ 956.269994] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: SUCCESS [ 956.270491] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.272195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.272195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.272195] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.272195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.272195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.272195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.272195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.272195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.272195] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.418639] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.454836] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.454983] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.455058] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.455331] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.455458] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.455650] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.456358] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.456358] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.456358] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.456358] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.456358] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45614c93-85f6-4dc6-92a5-f7ed3744cf81 already deleted. [ 956.456358] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45614c93-85f6-4dc6-92a5-f7ed3744cf81" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.518153] env[70520]: INFO networking_nsxv3.common.synchronization [req-fd2d0ac6-60fe-4b6c-9ff0-08c976e8265f req-cf75bade-3b9e-4dc6-b009-5cb254fdc9db tempest-DeleteServersTestJSON-1399047283 tempest-DeleteServersTestJSON-1399047283-project-member] Enqueued Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 956.518153] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 956.518153] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.518153] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.518153] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.518153] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.518153] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.518153] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.518730] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.518730] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.518730] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.518730] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.774675] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.774825] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.774910] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.775128] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.775664] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.775796] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.775846] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.776020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.776107] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.776197] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.776350] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.776442] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.776504] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.776672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.776813] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.776904] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.776964] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.777290] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.777290] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.777290] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.777442] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.910275] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653491db-2944-4ea2-bef7-8e2800a4b41b in Status: SUCCESS [ 956.910425] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 653491db-2944-4ea2-bef7-8e2800a4b41b deletion is rescheduled due to dependency. [ 956.910546] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653491db-2944-4ea2-bef7-8e2800a4b41b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.921586] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.921898] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.921898] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.922902] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.923022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.923128] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 is going to be updated. [ 956.955267] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.955426] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.955499] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.955727] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.955895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.966163] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: IN_PROGRESS for 2s [ 956.988813] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-493 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.989054] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-493" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.989187] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-493" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.993021] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-493" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.993021] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.993021] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.993021] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.993021] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.993021] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.993021] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 956.993021] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 956.993021] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 956.993021] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 956.993021] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 956.995103] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 956.996115] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 957.019558] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 957.019558] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 957.019558] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 957.019558] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-493" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.019558] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-16b06824-169a-402f-a0b2-2b969f5f68f1 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.019558] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-16b06824-169a-402f-a0b2-2b969f5f68f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.019558] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-16b06824-169a-402f-a0b2-2b969f5f68f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.019558] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-16b06824-169a-402f-a0b2-2b969f5f68f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.019558] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16b06824-169a-402f-a0b2-2b969f5f68f1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.021964] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.022254] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.024492] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.024492] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.024492] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.024492] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.024492] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.024492] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.024492] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.024492] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.024492] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f is going to be deleted. [ 957.054132] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.054309] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.054407] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.054667] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.054766] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.054859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.280607] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4e36438-996a-4d8f-adfb-5a87b2e7bd82: rpc.has_security_group_logging(os_id): False [ 957.300178] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.300317] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.300383] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.300597] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.319835] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.320156] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.320315] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.320411] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.320680] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.320776] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.321115] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.321233] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.321347] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.321547] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.321650] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.321872] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.321994] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.322075] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.322237] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.322331] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.322472] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 is going to be updated. [ 957.381327] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.381458] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.381587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.381729] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.381862] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.394335] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: IN_PROGRESS for 2s [ 957.522801] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.523057] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.523200] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.524031] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.524031] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.524031] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 16b06824-169a-402f-a0b2-2b969f5f68f1 not found, creating... [ 957.524218] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.524218] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.524344] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.524585] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.524721] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.525016] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.525182] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.525302] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.525517] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.525653] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.525795] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 16b06824-169a-402f-a0b2-2b969f5f68f1 is going to be created. [ 957.547015] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.547236] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.547364] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.547679] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.547929] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.548304] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-16b06824-169a-402f-a0b2-2b969f5f68f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.716013] env[70520]: INFO networking_nsxv3.common.synchronization [req-fd2d0ac6-60fe-4b6c-9ff0-08c976e8265f req-7cb8629e-ac81-4233-bc3d-249a95c3f822 service nova] Enqueued Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_rules [ 958.716265] env[70520]: INFO networking_nsxv3.common.synchronization [req-fd2d0ac6-60fe-4b6c-9ff0-08c976e8265f req-7cb8629e-ac81-4233-bc3d-249a95c3f822 service nova] Enqueued Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 958.719262] env[70520]: INFO networking_nsxv3.common.synchronization [req-fd2d0ac6-60fe-4b6c-9ff0-08c976e8265f req-7cb8629e-ac81-4233-bc3d-249a95c3f822 service nova] Enqueued Resource ID: 16b06824-169a-402f-a0b2-2b969f5f68f1 with Priority: HIGHEST for action port [ 958.719262] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_rules [ 958.719262] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 958.719262] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16b06824-169a-402f-a0b2-2b969f5f68f1 with Priority: HIGHEST for action port [ 958.719262] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.719262] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.719262] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.719262] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.719262] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.719262] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.719262] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.719262] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.720037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.720037] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.720037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.720037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.720037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.720037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.720037] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.726023] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-16b06824-169a-402f-a0b2-2b969f5f68f1 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.726023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16b06824-169a-402f-a0b2-2b969f5f68f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.726023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16b06824-169a-402f-a0b2-2b969f5f68f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.726023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16b06824-169a-402f-a0b2-2b969f5f68f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.726023] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16b06824-169a-402f-a0b2-2b969f5f68f1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.978156] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: SUCCESS [ 958.978387] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.978579] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.978794] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.978997] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.979140] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.980616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.980616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.980616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.980616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.980616] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.980616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.980616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.980616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.980616] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.980616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.980616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.980616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.980616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.980616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.980616] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.981758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.982587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.982587] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.982587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.982587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.982587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.982587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.982587] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.225130] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.226241] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.226350] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.232978] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16b06824-169a-402f-a0b2-2b969f5f68f1 with status ACTIVE [ 959.232978] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.232978] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.232978] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.232978] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.232978] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.233275] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.233275] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.233275] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.233364] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.233393] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.234489] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.234489] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.234489] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.234489] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.234489] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.234489] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16b06824-169a-402f-a0b2-2b969f5f68f1 is going to be updated. [ 959.259198] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.259370] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.259448] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.259665] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.259965] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.261422] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16b06824-169a-402f-a0b2-2b969f5f68f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.413271] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: SUCCESS [ 959.414448] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.486155] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.488234] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b22ab11-3a43-4e3c-a9ac-8ee49b487341: rpc.has_security_group_logging(os_id): False [ 959.509159] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.509159] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.509159] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.509159] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.529917] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.529917] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.529917] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.529917] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.530206] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.530307] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.530498] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.530591] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.530655] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.530793] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.530879] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.531157] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.531650] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.531650] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.531650] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.531816] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.531852] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 is going to be updated. [ 959.649762] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.649943] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.649985] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.650204] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.650394] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.697154] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: IN_PROGRESS for 2s [ 959.728733] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.989252] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.232066] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.232244] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.232325] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.232550] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.232643] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.232750] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f is going to be created. [ 960.260221] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.260394] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.260440] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.260684] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.260869] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.272079] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: UNINITIALIZED for 2s [ 960.491860] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.492918] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.492918] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.492918] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.492918] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.492918] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 is going to be updated. [ 960.527150] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.527441] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.527441] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.527579] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.528253] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.538909] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: IN_PROGRESS for 2s [ 961.220366] env[70520]: INFO networking_nsxv3.common.synchronization [req-ee2a99ea-546e-4a44-9011-36bf1d598c1a req-688e63d9-773d-45b9-9947-22ce92806b5f tempest-ServersNegativeTestMultiTenantJSON-601382293 tempest-ServersNegativeTestMultiTenantJSON-601382293-project-member] Enqueued Resource ID: d77f36dd-6e19-41b5-98f9-4bafae832400 with Priority: HIGHEST for action security_group_members [ 961.220366] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d77f36dd-6e19-41b5-98f9-4bafae832400 with Priority: HIGHEST for action security_group_members [ 961.220366] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d77f36dd-6e19-41b5-98f9-4bafae832400 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.220366] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.220366] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.224762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.224762] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.224762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.224762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.224762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.224762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.224762] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d77f36dd-6e19-41b5-98f9-4bafae832400',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.717118] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: SUCCESS [ 961.719073] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.719264] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.720438] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.720438] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.729460] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.729460] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.729460] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.729460] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.756224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.756224] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.756224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.756224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.756224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.756224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.756224] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d77f36dd-6e19-41b5-98f9-4bafae832400 is going to be updated. [ 961.799726] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.799965] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.800084] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.800359] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.801174] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.812216] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d77f36dd-6e19-41b5-98f9-4bafae832400 in Status: IN_PROGRESS for 2s [ 962.223534] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.223902] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.283219] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: SUCCESS [ 962.283473] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.283739] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.284248] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.284660] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.284756] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.284756] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.284963] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.285086] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.285740] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.285740] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.551697] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: SUCCESS [ 962.551893] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.552077] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.552316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.552510] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.552632] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.552698] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.552854] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.552929] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.553022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.553114] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.792659] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.792659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.792659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.792659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.792659] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.792659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.792659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.792659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.792659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.792659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.792659] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.792659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.792659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.792659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.792659] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.792659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.793746] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.793746] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.793746] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.793746] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.793746] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.055509] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.056411] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.056578] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.056967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.058203] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.058464] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.058731] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.059076] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.059380] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.059748] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.060900] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.063237] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.063320] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.063560] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.063776] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.063941] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.063991] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.064176] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.064331] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.064375] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.064470] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.298743] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 80751702-3cad-4ef3-af48-e8bd866c7e7f: rpc.has_security_group_logging(os_id): False [ 963.319863] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.320009] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.320084] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.320293] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.320379] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.320591] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.320691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.320755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.320904] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.320977] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.321164] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.321775] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.321775] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.321775] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.321775] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.321775] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.321775] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.322795] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.322795] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.322795] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.322795] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f is going to be created. [ 963.394908] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.394908] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.395484] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.395484] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.395484] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.414136] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: IN_PROGRESS for 2s [ 963.566809] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b22ab11-3a43-4e3c-a9ac-8ee49b487341: rpc.has_security_group_logging(os_id): False [ 963.587513] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.587673] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.587728] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.587939] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.588043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.588261] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.588361] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.588423] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.588583] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.588661] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.588836] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.588935] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.589030] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.589236] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.589320] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.589551] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.589622] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.589656] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.589787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.589860] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.589943] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 is going to be updated. [ 963.681390] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.681604] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.681604] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.682123] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.682409] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.703131] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: IN_PROGRESS for 2s [ 963.822628] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d77f36dd-6e19-41b5-98f9-4bafae832400 in Status: SUCCESS [ 963.822856] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d77f36dd-6e19-41b5-98f9-4bafae832400 deletion is rescheduled due to dependency. [ 963.822944] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.430345] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: SUCCESS [ 965.430345] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.722060] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: SUCCESS [ 965.722295] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.220885] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 966.220995] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 969.753400] env[70520]: INFO networking_nsxv3.common.synchronization [None req-1f94ef26-6dc7-41c1-933f-bfadb6e22162 None None] Enqueued Resource ID: 2b63cb2d-c572-4fb1-82a2-99ea0ee4576d with Priority: HIGHEST for action port [ 969.753680] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b63cb2d-c572-4fb1-82a2-99ea0ee4576d with Priority: HIGHEST for action port [ 969.754341] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b63cb2d-c572-4fb1-82a2-99ea0ee4576d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.754485] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b63cb2d-c572-4fb1-82a2-99ea0ee4576d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.754570] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b63cb2d-c572-4fb1-82a2-99ea0ee4576d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.754828] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b63cb2d-c572-4fb1-82a2-99ea0ee4576d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.754927] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b63cb2d-c572-4fb1-82a2-99ea0ee4576d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.259317] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b63cb2d-c572-4fb1-82a2-99ea0ee4576d [ 970.259551] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.260013] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.260013] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.260156] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.260272] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.260417] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b63cb2d-c572-4fb1-82a2-99ea0ee4576d already deleted. [ 970.260546] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b63cb2d-c572-4fb1-82a2-99ea0ee4576d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.204055] env[70520]: INFO networking_nsxv3.common.synchronization [None req-62987bfd-fac3-4dca-8b7e-c0ac5bdc95b3 None None] Enqueued Resource ID: 0d86f5e7-0c81-4c60-b9a8-cc3fde2e4375 with Priority: HIGHEST for action port [ 972.204719] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d86f5e7-0c81-4c60-b9a8-cc3fde2e4375 with Priority: HIGHEST for action port [ 972.205249] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d86f5e7-0c81-4c60-b9a8-cc3fde2e4375 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.205444] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d86f5e7-0c81-4c60-b9a8-cc3fde2e4375" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.205543] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d86f5e7-0c81-4c60-b9a8-cc3fde2e4375" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.205870] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d86f5e7-0c81-4c60-b9a8-cc3fde2e4375" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.206032] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d86f5e7-0c81-4c60-b9a8-cc3fde2e4375',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.283096] env[70520]: INFO networking_nsxv3.common.synchronization [req-f1f2c4ee-ea2e-4e99-a3dc-e656890f47f5 req-dc2907ff-5bd2-40e7-942b-51fa6b115800 tempest-ServersTestManualDisk-1453882973 tempest-ServersTestManualDisk-1453882973-project-member] Enqueued Resource ID: 7c9dafc4-e7ff-4514-ba35-e91b76e57256 with Priority: HIGHEST for action security_group_members [ 972.283096] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c9dafc4-e7ff-4514-ba35-e91b76e57256 with Priority: HIGHEST for action security_group_members [ 972.283096] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c9dafc4-e7ff-4514-ba35-e91b76e57256 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.283096] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c9dafc4-e7ff-4514-ba35-e91b76e57256" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.283096] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c9dafc4-e7ff-4514-ba35-e91b76e57256" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.283096] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c9dafc4-e7ff-4514-ba35-e91b76e57256" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.283096] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.284475] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.284566] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.284775] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.284867] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.284971] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c9dafc4-e7ff-4514-ba35-e91b76e57256',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.710541] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d86f5e7-0c81-4c60-b9a8-cc3fde2e4375 [ 972.711250] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.711250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.711250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.711250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.711451] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.711451] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d86f5e7-0c81-4c60-b9a8-cc3fde2e4375 already deleted. [ 972.711451] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d86f5e7-0c81-4c60-b9a8-cc3fde2e4375" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.789081] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.789788] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.789788] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.789788] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.816242] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.816521] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.816741] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.819018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.819018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.819018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.819018] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c9dafc4-e7ff-4514-ba35-e91b76e57256 is going to be updated. [ 972.847658] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.847658] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.847658] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.847658] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.847658] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.856609] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c9dafc4-e7ff-4514-ba35-e91b76e57256 in Status: IN_PROGRESS for 2s [ 972.889911] env[70520]: INFO networking_nsxv3.common.synchronization [req-6442d29c-f7fe-425c-b5e4-c7e4dc539d42 req-04b8ffe7-778a-469a-b85d-7fa0a4dbff98 tempest-ServerActionsTestOtherB-256435736 tempest-ServerActionsTestOtherB-256435736-project-member] Enqueued Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_members [ 972.890302] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_members [ 972.890889] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d7f9020-5060-4aaf-81f1-cec3849eacc0 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.890889] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.890889] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.891097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.893041] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.893041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.893041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.893041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.893041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.893041] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.238558] env[70520]: INFO networking_nsxv3.common.synchronization [req-022d9fee-e0be-4f6f-bf7b-38a9994beb0f req-90a72672-a948-4706-9318-07e758e3cf15 tempest-MigrationsAdminTest-360924409 tempest-MigrationsAdminTest-360924409-project-member] Enqueued Resource ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 with Priority: HIGHEST for action security_group_members [ 973.239112] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 with Priority: HIGHEST for action security_group_members [ 973.240446] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f391db-1908-4d0d-afa1-a1da6f6944f6 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.240446] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.240631] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.240738] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.240937] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.241079] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.241160] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.241335] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.241462] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.241952] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17f391db-1908-4d0d-afa1-a1da6f6944f6',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.395565] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.395565] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.395565] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.395841] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.418499] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.418764] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.418892] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.418960] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.419173] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.419252] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.419342] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 is going to be updated. [ 973.451171] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.451171] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.451171] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.453864] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.454155] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.473159] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: IN_PROGRESS for 2s [ 973.745834] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17f391db-1908-4d0d-afa1-a1da6f6944f6',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.038904] env[70520]: INFO networking_nsxv3.common.synchronization [req-9be1ef31-2960-449a-9a1f-ee7ffaec94cf req-bb558004-bb5c-4d88-8ecf-52a71d751b79 tempest-ServersTestBootFromVolume-1414622987 tempest-ServersTestBootFromVolume-1414622987-project-member] Enqueued Resource ID: e1706c97-ada0-42a9-ae16-d557fcd51adb with Priority: HIGHEST for action security_group_members [ 974.039494] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1706c97-ada0-42a9-ae16-d557fcd51adb with Priority: HIGHEST for action security_group_members [ 974.039841] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1706c97-ada0-42a9-ae16-d557fcd51adb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.040017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.040094] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.040308] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.040468] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.040559] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.040616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.040768] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.040853] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.040944] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1706c97-ada0-42a9-ae16-d557fcd51adb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.249761] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17f391db-1908-4d0d-afa1-a1da6f6944f6',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.544534] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.544534] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.544534] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.544534] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.544875] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.544875] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.544953] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.545097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.545181] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.545310] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.545341] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1706c97-ada0-42a9-ae16-d557fcd51adb already deleted. [ 974.545405] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.560593] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-532 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.560834] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-532" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.560983] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-532" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.561338] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-532" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.561601] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.561763] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.562796] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.562796] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.562796] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.564961] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 974.564961] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 974.564961] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 974.564961] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 974.564961] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 974.564961] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 974.564961] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 974.587437] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 974.587643] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 974.588155] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 974.588358] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-532" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.588703] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-c2cdbba6-60b2-4018-ae5f-9bf11157549b taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.588884] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-c2cdbba6-60b2-4018-ae5f-9bf11157549b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.589437] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-c2cdbba6-60b2-4018-ae5f-9bf11157549b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.589843] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-c2cdbba6-60b2-4018-ae5f-9bf11157549b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.590015] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2cdbba6-60b2-4018-ae5f-9bf11157549b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.758245] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.758245] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.758245] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.758245] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.758245] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.758245] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 is going to be updated. [ 974.819936] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.819936] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.819936] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.820222] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.820501] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.834612] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 in Status: IN_PROGRESS for 2s [ 974.867516] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c9dafc4-e7ff-4514-ba35-e91b76e57256 in Status: SUCCESS [ 974.867708] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c9dafc4-e7ff-4514-ba35-e91b76e57256 deletion is rescheduled due to dependency. [ 974.868048] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c9dafc4-e7ff-4514-ba35-e91b76e57256" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.094475] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.095727] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.095727] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.095727] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.095727] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.095727] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port c2cdbba6-60b2-4018-ae5f-9bf11157549b not found, creating... [ 975.096022] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.096114] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.096235] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.096491] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.096659] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.097062] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.097290] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.097403] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.097733] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.097882] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.098028] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: c2cdbba6-60b2-4018-ae5f-9bf11157549b is going to be created. [ 975.120570] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.120905] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.120990] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.121309] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.121802] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.121868] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-c2cdbba6-60b2-4018-ae5f-9bf11157549b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.483623] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: SUCCESS [ 975.484008] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 deletion is rescheduled due to dependency. [ 975.484008] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.924357] env[70520]: INFO networking_nsxv3.common.synchronization [req-9be1ef31-2960-449a-9a1f-ee7ffaec94cf req-4cbfad25-e74e-4219-87f3-05f56a6e108f service nova] Enqueued Resource ID: e1706c97-ada0-42a9-ae16-d557fcd51adb with Priority: HIGHEST for action security_group_rules [ 975.924357] env[70520]: INFO networking_nsxv3.common.synchronization [req-9be1ef31-2960-449a-9a1f-ee7ffaec94cf req-4cbfad25-e74e-4219-87f3-05f56a6e108f service nova] Enqueued Resource ID: e1706c97-ada0-42a9-ae16-d557fcd51adb with Priority: HIGHEST for action security_group_members [ 975.924357] env[70520]: INFO networking_nsxv3.common.synchronization [req-9be1ef31-2960-449a-9a1f-ee7ffaec94cf req-4cbfad25-e74e-4219-87f3-05f56a6e108f service nova] Enqueued Resource ID: c2cdbba6-60b2-4018-ae5f-9bf11157549b with Priority: HIGHEST for action port [ 975.924357] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1706c97-ada0-42a9-ae16-d557fcd51adb with Priority: HIGHEST for action security_group_rules [ 975.924357] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1706c97-ada0-42a9-ae16-d557fcd51adb with Priority: HIGHEST for action security_group_members [ 975.924357] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2cdbba6-60b2-4018-ae5f-9bf11157549b with Priority: HIGHEST for action port [ 975.925468] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1706c97-ada0-42a9-ae16-d557fcd51adb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.925801] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.925991] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.926373] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.926569] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1706c97-ada0-42a9-ae16-d557fcd51adb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.927615] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1706c97-ada0-42a9-ae16-d557fcd51adb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.927937] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.928139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.928471] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.929082] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.929082] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.929082] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.929458] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.929754] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.932206] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1706c97-ada0-42a9-ae16-d557fcd51adb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.932206] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2cdbba6-60b2-4018-ae5f-9bf11157549b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.932206] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2cdbba6-60b2-4018-ae5f-9bf11157549b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.932206] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2cdbba6-60b2-4018-ae5f-9bf11157549b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.932206] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2cdbba6-60b2-4018-ae5f-9bf11157549b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.932206] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2cdbba6-60b2-4018-ae5f-9bf11157549b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.438023] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1706c97-ada0-42a9-ae16-d557fcd51adb taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.438023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.438023] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2cdbba6-60b2-4018-ae5f-9bf11157549b with status ACTIVE [ 976.438023] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.438023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.438023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.438023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.438023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.438023] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.438023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.438023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.438023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.438023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.438023] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.438659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.438659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.438659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.438659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.438659] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2cdbba6-60b2-4018-ae5f-9bf11157549b is going to be updated. [ 976.440948] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e1706c97-ada0-42a9-ae16-d557fcd51adb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.466245] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.466245] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.466245] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.466245] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.466245] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.466245] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2cdbba6-60b2-4018-ae5f-9bf11157549b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.847029] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 in Status: SUCCESS [ 976.847029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.945060] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e1706c97-ada0-42a9-ae16-d557fcd51adb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.450350] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.450663] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.450663] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.450774] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.450935] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.451053] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1706c97-ada0-42a9-ae16-d557fcd51adb is going to be created. [ 977.477540] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.477759] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.477811] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.477991] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.478166] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.488850] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1706c97-ada0-42a9-ae16-d557fcd51adb in Status: UNINITIALIZED for 2s [ 977.898062] env[70520]: INFO networking_nsxv3.common.synchronization [None req-c6bae5c9-ba47-4214-af8f-ea023925430f tempest-ServerDiskConfigTestJSON-984450191 tempest-ServerDiskConfigTestJSON-984450191-project-member] Enqueued Resource ID: 70d43d56-3704-4c04-aa13-6a79279914aa with Priority: HIGHEST for action security_group_rules [ 977.898679] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70d43d56-3704-4c04-aa13-6a79279914aa with Priority: HIGHEST for action security_group_rules [ 977.898989] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70d43d56-3704-4c04-aa13-6a79279914aa taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.899130] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70d43d56-3704-4c04-aa13-6a79279914aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.899199] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70d43d56-3704-4c04-aa13-6a79279914aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.899453] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70d43d56-3704-4c04-aa13-6a79279914aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.899536] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70d43d56-3704-4c04-aa13-6a79279914aa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.066184] env[70520]: INFO networking_nsxv3.common.synchronization [None req-b2f96ce6-3026-4047-8e56-12ab109d1eb4 tempest-ServerDiskConfigTestJSON-984450191 tempest-ServerDiskConfigTestJSON-984450191-project-member] Enqueued Resource ID: 70d43d56-3704-4c04-aa13-6a79279914aa with Priority: HIGHEST for action security_group_rules [ 978.066810] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70d43d56-3704-4c04-aa13-6a79279914aa with Priority: HIGHEST for action security_group_rules [ 978.067150] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70d43d56-3704-4c04-aa13-6a79279914aa taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.067285] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70d43d56-3704-4c04-aa13-6a79279914aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.423475] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.423616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.423686] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.423889] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.423979] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.425226] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70d43d56-3704-4c04-aa13-6a79279914aa already deleted. [ 978.425366] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70d43d56-3704-4c04-aa13-6a79279914aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.428522] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70d43d56-3704-4c04-aa13-6a79279914aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.428522] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70d43d56-3704-4c04-aa13-6a79279914aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.428522] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70d43d56-3704-4c04-aa13-6a79279914aa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.949525] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.949525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.949964] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.949964] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.949964] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.950080] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70d43d56-3704-4c04-aa13-6a79279914aa already deleted. [ 978.950155] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70d43d56-3704-4c04-aa13-6a79279914aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.501686] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1706c97-ada0-42a9-ae16-d557fcd51adb in Status: SUCCESS [ 979.501943] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.502914] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.502914] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.502914] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.502914] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.502914] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.503224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.503224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.503224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.503224] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e1706c97-ada0-42a9-ae16-d557fcd51adb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.006291] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e1706c97-ada0-42a9-ae16-d557fcd51adb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.510368] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e1706c97-ada0-42a9-ae16-d557fcd51adb: rpc.has_security_group_logging(os_id): False [ 980.533459] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.533688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.533688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.534127] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.534127] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.534875] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.534961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.535057] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.535237] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.535316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.537089] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1706c97-ada0-42a9-ae16-d557fcd51adb is going to be created. [ 980.616174] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.616464] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.616464] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.616692] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.617012] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.634863] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1706c97-ada0-42a9-ae16-d557fcd51adb in Status: IN_PROGRESS for 2s [ 980.767443] env[70520]: INFO networking_nsxv3.common.synchronization [req-d40d3569-57e4-4587-b519-b4cccdf891ba req-38709266-e2de-4c98-949a-79b2da076308 tempest-MultipleCreateTestJSON-1344547532 tempest-MultipleCreateTestJSON-1344547532-project-member] Enqueued Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_members [ 980.771025] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_members [ 980.771025] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.771025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.771025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.771025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.771025] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.771025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.771025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.771025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.771025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.771025] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.273027] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.273300] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.273300] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.273525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.298038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.298359] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.298460] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.298508] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.298723] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.298797] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.298891] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db is going to be updated. [ 981.325714] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.325912] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.326011] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.326270] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.326616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.345363] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: IN_PROGRESS for 2s [ 981.972671] env[70520]: INFO networking_nsxv3.common.synchronization [None req-c2ed6259-4c36-48cc-991a-4575883f55f1 None None] Enqueued Resource ID: f2009e50-df1c-4a32-b5bb-07475880b725 with Priority: HIGHEST for action port [ 981.972671] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2009e50-df1c-4a32-b5bb-07475880b725 with Priority: HIGHEST for action port [ 981.972671] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2009e50-df1c-4a32-b5bb-07475880b725 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.972671] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2009e50-df1c-4a32-b5bb-07475880b725" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.972671] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2009e50-df1c-4a32-b5bb-07475880b725" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.972671] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2009e50-df1c-4a32-b5bb-07475880b725" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.972671] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2009e50-df1c-4a32-b5bb-07475880b725',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.196031] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-581 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.196031] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-581" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.196031] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-581" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.196031] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-581" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.196031] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.196031] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.196031] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.196031] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.196031] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.196031] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 982.196031] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 982.196031] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 982.196031] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 982.196792] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 982.196792] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 982.196792] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 982.222827] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 982.223322] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 982.223664] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 982.224098] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-581" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.224686] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-1fc9d4ff-c5e4-49ea-b466-79047dd74768 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.225048] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-1fc9d4ff-c5e4-49ea-b466-79047dd74768" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.225400] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-1fc9d4ff-c5e4-49ea-b466-79047dd74768" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.225984] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-1fc9d4ff-c5e4-49ea-b466-79047dd74768" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.226786] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fc9d4ff-c5e4-49ea-b466-79047dd74768',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.479115] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f2009e50-df1c-4a32-b5bb-07475880b725 [ 982.479115] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.479115] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.479115] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.479115] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.479115] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.479115] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f2009e50-df1c-4a32-b5bb-07475880b725 already deleted. [ 982.479115] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2009e50-df1c-4a32-b5bb-07475880b725" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.650710] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1706c97-ada0-42a9-ae16-d557fcd51adb in Status: SUCCESS [ 982.650953] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.730025] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.730582] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.733036] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.733036] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.733036] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.733036] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 1fc9d4ff-c5e4-49ea-b466-79047dd74768 not found, creating... [ 982.733036] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.733036] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.733036] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.733036] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.733036] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.734055] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.734428] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.734689] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.735095] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.735357] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.735639] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 1fc9d4ff-c5e4-49ea-b466-79047dd74768 is going to be created. [ 982.768409] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.768639] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.770217] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.770217] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.770217] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.770217] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-1fc9d4ff-c5e4-49ea-b466-79047dd74768" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.953802] env[70520]: INFO networking_nsxv3.common.synchronization [req-d40d3569-57e4-4587-b519-b4cccdf891ba req-47ff5194-e243-4fa9-881a-b06431b9566c tempest-MultipleCreateTestJSON-1344547532 tempest-MultipleCreateTestJSON-1344547532-project-member] Enqueued Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_members [ 982.955961] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_members [ 982.955961] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.955961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.361109] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: SUCCESS [ 983.361733] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db deletion is rescheduled due to dependency. [ 983.361733] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.363191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.363191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.363191] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.363191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.363191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.363191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.363191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.363789] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.866599] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.030288] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-581 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.033937] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-581" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.033937] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-581" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.034277] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-581" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.034506] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.034941] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.035119] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.035359] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.035575] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.035716] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 984.035832] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 984.035942] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 984.036059] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 984.036173] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 984.036281] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 984.036417] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 984.057958] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 984.058313] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 984.058313] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 984.058499] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-581" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.058752] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-746be8ea-ee6a-4583-adbf-5cd7b95df219 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.058921] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-746be8ea-ee6a-4583-adbf-5cd7b95df219" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.060019] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-746be8ea-ee6a-4583-adbf-5cd7b95df219" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.060019] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-746be8ea-ee6a-4583-adbf-5cd7b95df219" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.060019] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('746be8ea-ee6a-4583-adbf-5cd7b95df219',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.062741] env[70520]: INFO networking_nsxv3.common.synchronization [req-d40d3569-57e4-4587-b519-b4cccdf891ba req-03888739-1d23-4e20-b4e9-2237e49d6c10 service nova] Enqueued Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_rules [ 984.063274] env[70520]: INFO networking_nsxv3.common.synchronization [req-d40d3569-57e4-4587-b519-b4cccdf891ba req-03888739-1d23-4e20-b4e9-2237e49d6c10 service nova] Enqueued Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_members [ 984.063274] env[70520]: INFO networking_nsxv3.common.synchronization [req-d40d3569-57e4-4587-b519-b4cccdf891ba req-03888739-1d23-4e20-b4e9-2237e49d6c10 service nova] Enqueued Resource ID: 1fc9d4ff-c5e4-49ea-b466-79047dd74768 with Priority: HIGHEST for action port [ 984.063814] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_rules [ 984.063963] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_members [ 984.064075] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fc9d4ff-c5e4-49ea-b466-79047dd74768 with Priority: HIGHEST for action port [ 984.064355] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.064543] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.064651] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.064800] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.064878] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.066090] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.066324] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.066419] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fc9d4ff-c5e4-49ea-b466-79047dd74768 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.066966] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fc9d4ff-c5e4-49ea-b466-79047dd74768" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.066966] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fc9d4ff-c5e4-49ea-b466-79047dd74768" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.067272] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fc9d4ff-c5e4-49ea-b466-79047dd74768" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.067272] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fc9d4ff-c5e4-49ea-b466-79047dd74768',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.372391] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.564291] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.564528] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.564663] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.564979] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.565178] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.565339] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 746be8ea-ee6a-4583-adbf-5cd7b95df219 not found, creating... [ 984.565602] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.565764] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.565883] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.566490] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.566593] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.566932] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.567124] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.567269] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.567672] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.567890] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.567975] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 746be8ea-ee6a-4583-adbf-5cd7b95df219 is going to be created. [ 984.569551] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.569687] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.569822] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1fc9d4ff-c5e4-49ea-b466-79047dd74768 with status ACTIVE [ 984.569983] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.570110] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.570194] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.573256] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.573389] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.573577] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.573736] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.573922] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.574104] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.574195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.574424] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.574524] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.574586] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.574728] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.574802] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.574888] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1fc9d4ff-c5e4-49ea-b466-79047dd74768 is going to be updated. [ 984.595075] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.595336] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.595438] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.595761] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.595949] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.596195] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-746be8ea-ee6a-4583-adbf-5cd7b95df219" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.598848] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.598969] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.599058] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.599255] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.599381] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.599526] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fc9d4ff-c5e4-49ea-b466-79047dd74768" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.621169] env[70520]: INFO networking_nsxv3.common.synchronization [None req-bf19c90c-26a9-4096-97a5-d413ea45ee24 None None] Enqueued Resource ID: 3d74c4a4-bf62-45ce-8d3e-b158409d9d3d with Priority: HIGHEST for action port [ 984.621439] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d74c4a4-bf62-45ce-8d3e-b158409d9d3d with Priority: HIGHEST for action port [ 984.622030] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d74c4a4-bf62-45ce-8d3e-b158409d9d3d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.622160] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d74c4a4-bf62-45ce-8d3e-b158409d9d3d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.622225] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d74c4a4-bf62-45ce-8d3e-b158409d9d3d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.622485] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d74c4a4-bf62-45ce-8d3e-b158409d9d3d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.622569] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d74c4a4-bf62-45ce-8d3e-b158409d9d3d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.861329] env[70520]: INFO networking_nsxv3.common.synchronization [req-11ea6a1f-4779-4b1e-839e-4d1500981559 req-962feb55-1cbc-479e-8b9f-5db4be7997be tempest-ServerDiskConfigTestJSON-984450191 tempest-ServerDiskConfigTestJSON-984450191-project-member] Enqueued Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 984.862172] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 984.862755] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.862925] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.863140] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.863275] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.863477] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.863606] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.863692] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.863880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.863999] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.864131] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.879748] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.880165] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.880165] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.880306] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.880441] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.880549] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db is going to be updated. [ 984.921467] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.921637] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.921708] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.921941] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.922109] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.939132] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: IN_PROGRESS for 2s [ 985.127665] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d74c4a4-bf62-45ce-8d3e-b158409d9d3d [ 985.127933] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.128089] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.128152] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.128359] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.128445] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.128538] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d74c4a4-bf62-45ce-8d3e-b158409d9d3d already deleted. [ 985.128616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d74c4a4-bf62-45ce-8d3e-b158409d9d3d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.367339] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.367469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.367469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.368109] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.391088] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.391088] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.392044] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.392044] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.392044] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.392736] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.392736] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 is going to be updated. [ 985.420760] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.420928] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.420969] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.421382] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.421678] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.430786] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: IN_PROGRESS for 2s [ 986.308484] env[70520]: INFO networking_nsxv3.common.synchronization [req-d40d3569-57e4-4587-b519-b4cccdf891ba req-280ef21c-f908-492d-ab66-4371d3b32fdd service nova] Enqueued Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_rules [ 986.308484] env[70520]: INFO networking_nsxv3.common.synchronization [req-d40d3569-57e4-4587-b519-b4cccdf891ba req-280ef21c-f908-492d-ab66-4371d3b32fdd service nova] Enqueued Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_members [ 986.308484] env[70520]: INFO networking_nsxv3.common.synchronization [req-d40d3569-57e4-4587-b519-b4cccdf891ba req-280ef21c-f908-492d-ab66-4371d3b32fdd service nova] Enqueued Resource ID: 746be8ea-ee6a-4583-adbf-5cd7b95df219 with Priority: HIGHEST for action port [ 986.308484] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_rules [ 986.309281] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_members [ 986.309716] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 746be8ea-ee6a-4583-adbf-5cd7b95df219 with Priority: HIGHEST for action port [ 986.310335] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.312997] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.312997] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.312997] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.312997] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-746be8ea-ee6a-4583-adbf-5cd7b95df219 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.312997] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-746be8ea-ee6a-4583-adbf-5cd7b95df219" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.312997] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-746be8ea-ee6a-4583-adbf-5cd7b95df219" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.312997] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-746be8ea-ee6a-4583-adbf-5cd7b95df219" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.312997] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('746be8ea-ee6a-4583-adbf-5cd7b95df219',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.821511] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 746be8ea-ee6a-4583-adbf-5cd7b95df219 with status ACTIVE [ 986.821511] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.821511] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.821511] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.821511] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.821511] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.821511] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.821511] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.821511] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.821511] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.821511] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.821511] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.821511] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.821511] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.821511] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.821511] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.821511] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 746be8ea-ee6a-4583-adbf-5cd7b95df219 is going to be updated. [ 986.844766] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.845144] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.845144] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.846682] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.846682] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.846682] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-746be8ea-ee6a-4583-adbf-5cd7b95df219" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.951235] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: SUCCESS [ 986.951235] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.951235] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.951235] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.951235] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.951235] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.951235] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.951235] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.951235] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.951235] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.443319] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: SUCCESS [ 987.443319] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 deletion is rescheduled due to dependency. [ 987.443866] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.455456] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.957310] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.084533] env[70520]: INFO networking_nsxv3.common.synchronization [None req-0565a65f-f035-4808-8272-9edfbc3ea633 None None] Enqueued Resource ID: fb1b60c9-2477-4d0c-b4be-8c9d9b9d2ee6 with Priority: HIGHEST for action port [ 988.085943] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1b60c9-2477-4d0c-b4be-8c9d9b9d2ee6 with Priority: HIGHEST for action port [ 988.087767] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb1b60c9-2477-4d0c-b4be-8c9d9b9d2ee6 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.088125] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb1b60c9-2477-4d0c-b4be-8c9d9b9d2ee6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.088225] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb1b60c9-2477-4d0c-b4be-8c9d9b9d2ee6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.088511] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb1b60c9-2477-4d0c-b4be-8c9d9b9d2ee6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.088602] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb1b60c9-2477-4d0c-b4be-8c9d9b9d2ee6',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.462080] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.462856] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.462856] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.462856] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.462856] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.462856] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db is going to be updated. [ 988.583352] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.584226] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.584226] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.584226] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.584226] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.596576] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb1b60c9-2477-4d0c-b4be-8c9d9b9d2ee6 [ 988.596889] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.597059] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.597189] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.597357] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.597440] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.597533] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb1b60c9-2477-4d0c-b4be-8c9d9b9d2ee6 already deleted. [ 988.597609] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb1b60c9-2477-4d0c-b4be-8c9d9b9d2ee6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.598913] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: IN_PROGRESS for 2s [ 990.524617] env[70520]: INFO networking_nsxv3.common.synchronization [None req-7abc8ab7-e8ec-4c4b-a7b4-a880c936064f None None] Enqueued Resource ID: 7d617259-62cc-4ab3-9145-32bdc2e1f85e with Priority: HIGHEST for action port [ 990.525065] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d617259-62cc-4ab3-9145-32bdc2e1f85e with Priority: HIGHEST for action port [ 990.526492] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d617259-62cc-4ab3-9145-32bdc2e1f85e taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.526492] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d617259-62cc-4ab3-9145-32bdc2e1f85e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.526492] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d617259-62cc-4ab3-9145-32bdc2e1f85e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.526492] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d617259-62cc-4ab3-9145-32bdc2e1f85e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.526492] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d617259-62cc-4ab3-9145-32bdc2e1f85e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.613974] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: SUCCESS [ 990.613974] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.613974] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.613974] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.613974] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.613974] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.613974] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.614496] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.614496] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.614496] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.614496] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.620349] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.620591] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.620797] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.620919] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.621049] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.621237] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.621347] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.621433] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.785881] env[70520]: INFO networking_nsxv3.common.synchronization [req-5be9d3d1-8c7b-4c74-ac0c-9ff9efba41e6 req-7dcaafa2-91d6-4184-b35b-f003fac11bda tempest-AttachInterfacesTestJSON-1687744298 tempest-AttachInterfacesTestJSON-1687744298-project-member] Enqueued Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_members [ 990.787126] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_members [ 990.787584] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.787759] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.790783] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.790783] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.790783] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.790783] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.790783] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.790783] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.790783] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.790783] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.876547] env[70520]: INFO networking_nsxv3.common.synchronization [req-4f75af19-0bff-4d20-9933-34410944e1c5 req-a8c0ec72-1b66-457b-8504-f610f53cb0a5 tempest-ServerActionsTestOtherA-325270290 tempest-ServerActionsTestOtherA-325270290-project-member] Enqueued Resource ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa with Priority: HIGHEST for action security_group_members [ 990.879437] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa with Priority: HIGHEST for action security_group_members [ 990.879437] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.879437] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.879437] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.879437] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.879437] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.879678] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.879678] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.879732] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.881312] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.881312] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9526fc0a-60e6-4c7c-a0b5-b827fe4038aa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.028757] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7d617259-62cc-4ab3-9145-32bdc2e1f85e [ 991.028757] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.028757] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.028757] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.029321] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.029539] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.029698] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7d617259-62cc-4ab3-9145-32bdc2e1f85e already deleted. [ 991.029834] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d617259-62cc-4ab3-9145-32bdc2e1f85e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.125172] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.125285] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.125431] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.293924] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.294015] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.294069] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.294372] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.294372] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.294763] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.294763] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.294763] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.294979] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.294979] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.294979] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a already deleted. [ 991.295109] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.384122] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.385364] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.385429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.385604] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.385692] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.385921] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.386118] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.386118] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.386222] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.386300] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.386595] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa already deleted. [ 991.386595] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.572602] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-631 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.572909] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.572947] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.575160] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.575160] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.575160] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.575160] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.575160] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.578358] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.578670] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 991.578813] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 991.578997] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 991.579165] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 991.579296] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 991.579408] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 991.579582] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 991.602796] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 991.602965] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 991.603832] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 991.603832] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.604501] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-0c13727e-ec12-4529-a432-72929f806507 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.605289] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-0c13727e-ec12-4529-a432-72929f806507" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.605457] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-0c13727e-ec12-4529-a432-72929f806507" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.606652] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-0c13727e-ec12-4529-a432-72929f806507" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.606972] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c13727e-ec12-4529-a432-72929f806507',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.631494] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.918659] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-572 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.918659] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-572" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.918659] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-572" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.920752] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-572" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.925554] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.925554] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.925554] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.925554] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.925554] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.925554] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 991.925554] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 991.925554] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 991.925554] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 991.925554] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 991.925554] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 991.925554] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 991.949072] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 991.949614] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 991.949614] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 991.949904] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-572" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.950378] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-03343218-a875-4f18-92c3-f214284949d8 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.950963] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-03343218-a875-4f18-92c3-f214284949d8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.951197] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-03343218-a875-4f18-92c3-f214284949d8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.951654] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-03343218-a875-4f18-92c3-f214284949d8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.951743] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03343218-a875-4f18-92c3-f214284949d8',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.118035] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.118035] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.118035] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.118035] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.118035] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.118035] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 0c13727e-ec12-4529-a432-72929f806507 not found, creating... [ 992.118035] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.118035] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.118035] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.130042] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.130042] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.130042] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.130042] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.130042] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.130042] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.130042] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.130042] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 0c13727e-ec12-4529-a432-72929f806507 is going to be created. [ 992.135620] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.135620] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.135828] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.136231] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.136362] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.136560] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db is going to be updated. [ 992.159138] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.159138] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.159138] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.159138] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.159138] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.159138] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-0c13727e-ec12-4529-a432-72929f806507" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.192704] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.192704] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.192704] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.192704] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.192704] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.209035] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: IN_PROGRESS for 2s [ 992.352109] env[70520]: INFO networking_nsxv3.common.synchronization [None req-da7ab2c6-84c2-4115-ad02-aaf4cc32acb3 None None] Enqueued Resource ID: b2b9dcd7-564f-4dff-abb0-54aeab10f90b with Priority: HIGHEST for action port [ 992.352732] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2b9dcd7-564f-4dff-abb0-54aeab10f90b with Priority: HIGHEST for action port [ 992.353494] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2b9dcd7-564f-4dff-abb0-54aeab10f90b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.353494] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2b9dcd7-564f-4dff-abb0-54aeab10f90b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.353494] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2b9dcd7-564f-4dff-abb0-54aeab10f90b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.353740] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2b9dcd7-564f-4dff-abb0-54aeab10f90b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.353740] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2b9dcd7-564f-4dff-abb0-54aeab10f90b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.459575] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.459823] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.459957] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.460278] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.460434] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.460593] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 03343218-a875-4f18-92c3-f214284949d8 not found, creating... [ 992.460868] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.461071] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.461175] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.461397] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.461541] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.461840] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.462018] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.464098] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.464763] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.467281] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.467455] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 03343218-a875-4f18-92c3-f214284949d8 is going to be created. [ 992.490119] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.490346] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.490490] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.490890] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.491113] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.491372] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-03343218-a875-4f18-92c3-f214284949d8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.856704] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b2b9dcd7-564f-4dff-abb0-54aeab10f90b [ 992.857105] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.857105] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.857277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.857362] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.857454] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.857548] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b2b9dcd7-564f-4dff-abb0-54aeab10f90b already deleted. [ 992.857676] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2b9dcd7-564f-4dff-abb0-54aeab10f90b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.095551] env[70520]: INFO networking_nsxv3.common.synchronization [req-5be9d3d1-8c7b-4c74-ac0c-9ff9efba41e6 req-ad27caa1-40fa-4059-b606-d985a434995e service nova] Enqueued Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_rules [ 993.095840] env[70520]: INFO networking_nsxv3.common.synchronization [req-5be9d3d1-8c7b-4c74-ac0c-9ff9efba41e6 req-ad27caa1-40fa-4059-b606-d985a434995e service nova] Enqueued Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_members [ 993.095938] env[70520]: INFO networking_nsxv3.common.synchronization [req-5be9d3d1-8c7b-4c74-ac0c-9ff9efba41e6 req-ad27caa1-40fa-4059-b606-d985a434995e service nova] Enqueued Resource ID: 0c13727e-ec12-4529-a432-72929f806507 with Priority: HIGHEST for action port [ 993.096562] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_rules [ 993.096693] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_members [ 993.096753] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c13727e-ec12-4529-a432-72929f806507 with Priority: HIGHEST for action port [ 993.097140] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.097216] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.097261] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.097691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.097691] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.098941] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.102211] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.102286] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.102501] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.103300] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.103300] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.103300] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.103300] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.103300] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.103300] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.104387] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c13727e-ec12-4529-a432-72929f806507 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.105049] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c13727e-ec12-4529-a432-72929f806507" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.105049] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c13727e-ec12-4529-a432-72929f806507" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.105049] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c13727e-ec12-4529-a432-72929f806507" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.105049] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c13727e-ec12-4529-a432-72929f806507',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.449129] env[70520]: INFO networking_nsxv3.common.synchronization [req-4f75af19-0bff-4d20-9933-34410944e1c5 req-d0d6f2e6-6389-4354-a30b-7ad726dd52a3 service nova] Enqueued Resource ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa with Priority: HIGHEST for action security_group_rules [ 993.449129] env[70520]: INFO networking_nsxv3.common.synchronization [req-4f75af19-0bff-4d20-9933-34410944e1c5 req-d0d6f2e6-6389-4354-a30b-7ad726dd52a3 service nova] Enqueued Resource ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa with Priority: HIGHEST for action security_group_members [ 993.449129] env[70520]: INFO networking_nsxv3.common.synchronization [req-4f75af19-0bff-4d20-9933-34410944e1c5 req-d0d6f2e6-6389-4354-a30b-7ad726dd52a3 service nova] Enqueued Resource ID: 03343218-a875-4f18-92c3-f214284949d8 with Priority: HIGHEST for action port [ 993.449129] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa with Priority: HIGHEST for action security_group_rules [ 993.449129] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa with Priority: HIGHEST for action security_group_members [ 993.449129] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03343218-a875-4f18-92c3-f214284949d8 with Priority: HIGHEST for action port [ 993.449129] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.449129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.449129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.449129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.449129] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9526fc0a-60e6-4c7c-a0b5-b827fe4038aa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.450241] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.450241] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.450335] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.450463] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.450614] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.450711] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.450765] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.450948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.451049] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.451228] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9526fc0a-60e6-4c7c-a0b5-b827fe4038aa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.452725] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-03343218-a875-4f18-92c3-f214284949d8 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.452725] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03343218-a875-4f18-92c3-f214284949d8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.452725] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03343218-a875-4f18-92c3-f214284949d8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.452912] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03343218-a875-4f18-92c3-f214284949d8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.452912] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03343218-a875-4f18-92c3-f214284949d8',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.608564] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.608779] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.608886] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.609863] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0c13727e-ec12-4529-a432-72929f806507 with status ACTIVE [ 993.610526] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.610526] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.610526] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.610526] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.610705] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.610788] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.610864] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.610911] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.611531] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.611634] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.611823] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.612119] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.612720] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.612720] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.612720] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.612720] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0c13727e-ec12-4529-a432-72929f806507 is going to be updated. [ 993.657263] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.657263] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.657263] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.657263] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.657263] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.657263] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c13727e-ec12-4529-a432-72929f806507" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.955664] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9526fc0a-60e6-4c7c-a0b5-b827fe4038aa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.956991] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.957621] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.957621] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 03343218-a875-4f18-92c3-f214284949d8 with status ACTIVE [ 993.957621] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.957770] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.957770] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.958020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.958135] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.958321] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.960554] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.960554] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.960554] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.960554] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.960554] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.960554] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.960554] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.960554] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.960554] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.960554] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 03343218-a875-4f18-92c3-f214284949d8 is going to be updated. [ 993.980763] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.981041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.981041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.981191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.981565] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.981565] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03343218-a875-4f18-92c3-f214284949d8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.115068] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.222854] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: SUCCESS [ 994.223097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.223297] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.223565] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.223866] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.224074] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.224206] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.224422] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.224511] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.224601] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.224826] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.224958] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.226145] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.226393] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.226597] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.226781] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.226872] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.227149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.227302] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.227403] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.227501] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.461520] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9526fc0a-60e6-4c7c-a0b5-b827fe4038aa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.619321] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.619525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.619591] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.619756] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.619840] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.619934] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a is going to be created. [ 994.647421] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.647766] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.647766] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.647939] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.648224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.660866] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: UNINITIALIZED for 2s [ 994.700991] env[70520]: INFO networking_nsxv3.common.synchronization [None req-6f0e2846-229b-4eb8-984e-36bf14a78219 None None] Enqueued Resource ID: d190bc80-ada1-4ac0-acd7-0712e1175959 with Priority: HIGHEST for action port [ 994.701495] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d190bc80-ada1-4ac0-acd7-0712e1175959 with Priority: HIGHEST for action port [ 994.701900] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-d190bc80-ada1-4ac0-acd7-0712e1175959 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.702069] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d190bc80-ada1-4ac0-acd7-0712e1175959" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.702160] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d190bc80-ada1-4ac0-acd7-0712e1175959" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.702451] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d190bc80-ada1-4ac0-acd7-0712e1175959" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.702538] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d190bc80-ada1-4ac0-acd7-0712e1175959',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.730870] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d3e2e95-1306-419d-a0f9-f4e048bfb7db: rpc.has_security_group_logging(os_id): False [ 994.749951] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.750191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.750191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.750424] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.750506] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.750747] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.750747] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.750985] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.750985] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.751354] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.751354] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.752544] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.752544] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.752544] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.752544] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.752776] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.752776] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.752858] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.753025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.753097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.753189] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db is going to be updated. [ 994.824253] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.824253] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.824253] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.824253] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.824253] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.848685] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: IN_PROGRESS for 2s [ 994.965158] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.965544] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.965544] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.965726] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.965827] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.965933] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa is going to be created. [ 995.016924] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.017596] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.017596] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.018977] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.018977] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.034690] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa in Status: UNINITIALIZED for 2s [ 995.205392] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d190bc80-ada1-4ac0-acd7-0712e1175959 [ 995.205944] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.205944] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.205944] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.206263] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.206358] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.206469] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d190bc80-ada1-4ac0-acd7-0712e1175959 already deleted. [ 995.206586] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d190bc80-ada1-4ac0-acd7-0712e1175959" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.728622] env[70520]: INFO networking_nsxv3.common.synchronization [None req-7e398de5-9ef3-4d1b-b62e-021e1f8f9c53 tempest-AttachVolumeNegativeTest-1224878754 tempest-AttachVolumeNegativeTest-1224878754-project-member] Enqueued Resource ID: da040ed9-9da1-43c9-b672-1e4e957ffa6c with Priority: HIGHEST for action security_group_rules [ 995.729515] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da040ed9-9da1-43c9-b672-1e4e957ffa6c with Priority: HIGHEST for action security_group_rules [ 995.729605] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da040ed9-9da1-43c9-b672-1e4e957ffa6c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.729671] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da040ed9-9da1-43c9-b672-1e4e957ffa6c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.729717] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da040ed9-9da1-43c9-b672-1e4e957ffa6c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.729986] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da040ed9-9da1-43c9-b672-1e4e957ffa6c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.731020] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da040ed9-9da1-43c9-b672-1e4e957ffa6c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.851027] env[70520]: INFO networking_nsxv3.common.synchronization [None req-e7031d41-dc7f-4298-b532-6ea0bb05ff19 tempest-AttachVolumeNegativeTest-1224878754 tempest-AttachVolumeNegativeTest-1224878754-project-member] Enqueued Resource ID: da040ed9-9da1-43c9-b672-1e4e957ffa6c with Priority: HIGHEST for action security_group_rules [ 995.851260] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da040ed9-9da1-43c9-b672-1e4e957ffa6c with Priority: HIGHEST for action security_group_rules [ 995.851578] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da040ed9-9da1-43c9-b672-1e4e957ffa6c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.851659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da040ed9-9da1-43c9-b672-1e4e957ffa6c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.262327] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.262701] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.262701] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.262701] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.262792] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.262871] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da040ed9-9da1-43c9-b672-1e4e957ffa6c already deleted. [ 996.262954] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da040ed9-9da1-43c9-b672-1e4e957ffa6c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.263482] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da040ed9-9da1-43c9-b672-1e4e957ffa6c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.263635] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da040ed9-9da1-43c9-b672-1e4e957ffa6c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.263733] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da040ed9-9da1-43c9-b672-1e4e957ffa6c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.678025] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: SUCCESS [ 996.678025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.678025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.678025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.678025] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.678025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.678025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.678025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.678025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.678025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.678025] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.784140] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.784140] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.784140] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.784140] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.784140] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.784140] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da040ed9-9da1-43c9-b672-1e4e957ffa6c already deleted. [ 996.784140] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da040ed9-9da1-43c9-b672-1e4e957ffa6c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.862723] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: SUCCESS [ 996.863152] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.863290] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.863470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.863533] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.046204] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa in Status: SUCCESS [ 997.046436] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.046600] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.046822] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.047065] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.047200] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.047312] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.047511] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.047598] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.047688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.047784] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9526fc0a-60e6-4c7c-a0b5-b827fe4038aa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.180785] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.180938] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.181138] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.181301] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.181480] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.181589] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.181647] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.182195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.182195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.182195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.182195] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.182195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.182427] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.182496] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.182605] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.183018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.183018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.183018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.183184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.183184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.183258] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.366399] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.366832] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.366832] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.366972] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.367317] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.367445] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.367516] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.367735] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.367864] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.368045] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.368200] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.550142] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.550926] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.550926] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.550926] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.550926] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.550926] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.551175] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.551175] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.551285] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.551333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.551475] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.551562] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.551616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.551749] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.551886] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.551971] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.552037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.552166] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.552234] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.552799] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.552799] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9526fc0a-60e6-4c7c-a0b5-b827fe4038aa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.685802] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d217c04a-3f61-40d6-89c2-a60cc7eb772a: rpc.has_security_group_logging(os_id): False [ 997.703712] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.703856] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.703898] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.704127] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.704214] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.704402] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.704498] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.704559] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.704704] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.704838] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.705053] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.705140] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.705200] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.705335] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.705407] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.705580] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.705669] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.705727] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.705860] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.705930] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.706019] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a is going to be created. [ 997.768275] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.768275] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.768275] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.768275] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.768275] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.790886] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: IN_PROGRESS for 2s [ 997.870744] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.870912] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.870987] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.871244] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.871422] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.872359] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.872359] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.872359] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.872359] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.872359] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.872359] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.872714] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.872714] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.872714] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.872815] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.872913] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.872975] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.873161] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.873240] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.873325] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.873415] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.898427] env[70520]: INFO networking_nsxv3.common.synchronization [req-c82cbb6c-4608-4a63-b7e8-5b8461f8ae15 req-1ee35bd0-8e25-4f2e-88ac-d1939c63445a tempest-ServersAdminTestJSON-2063681355 tempest-ServersAdminTestJSON-2063681355-project-member] Enqueued Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_members [ 997.899599] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_members [ 997.900588] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.900708] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.900792] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.901110] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.901336] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.901506] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.901601] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.902092] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.902417] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.902570] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.944490] env[70520]: INFO networking_nsxv3.common.synchronization [req-173d8afc-e6dc-44f9-a780-bd630ceed017 req-1d7edf83-c6f3-4ddc-9e6a-d7a50834bfb9 tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 58197438-6dcb-404e-a8c1-aeacc2454958 with Priority: HIGHEST for action security_group_members [ 997.944765] env[70520]: INFO networking_nsxv3.common.synchronization [req-173d8afc-e6dc-44f9-a780-bd630ceed017 req-1d7edf83-c6f3-4ddc-9e6a-d7a50834bfb9 tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_members [ 997.944862] env[70520]: INFO networking_nsxv3.common.synchronization [req-173d8afc-e6dc-44f9-a780-bd630ceed017 req-1d7edf83-c6f3-4ddc-9e6a-d7a50834bfb9 tempest-SecurityGroupsTestJSON-1363219810 tempest-SecurityGroupsTestJSON-1363219810-project-member] Enqueued Resource ID: 4cfd4659-cc60-4e40-83b3-09f036d8f58c with Priority: HIGHEST for action security_group_members [ 997.945557] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58197438-6dcb-404e-a8c1-aeacc2454958 with Priority: HIGHEST for action security_group_members [ 997.945707] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 with Priority: HIGHEST for action security_group_members [ 997.945807] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cfd4659-cc60-4e40-83b3-09f036d8f58c with Priority: HIGHEST for action security_group_members [ 997.946157] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-58197438-6dcb-404e-a8c1-aeacc2454958 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.946737] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.946737] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.946737] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.946737] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.946970] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.946970] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.947440] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.947440] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.947440] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58197438-6dcb-404e-a8c1-aeacc2454958',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.949580] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.949580] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.949580] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.949580] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.949810] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.949810] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.949810] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.950217] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.950271] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.950381] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b22ab11-3a43-4e3c-a9ac-8ee49b487341',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.951488] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cfd4659-cc60-4e40-83b3-09f036d8f58c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.951638] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cfd4659-cc60-4e40-83b3-09f036d8f58c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.951783] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cfd4659-cc60-4e40-83b3-09f036d8f58c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.952232] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cfd4659-cc60-4e40-83b3-09f036d8f58c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.952232] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.952232] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.952431] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.952542] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.952665] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.952784] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cfd4659-cc60-4e40-83b3-09f036d8f58c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.054471] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa: rpc.has_security_group_logging(os_id): False [ 998.076022] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.076174] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.076249] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.076477] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.076565] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.076745] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.076865] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.076924] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.077104] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.077185] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.077402] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.077488] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.077549] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.080627] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.080627] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.080627] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.080627] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.080627] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.080627] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.080627] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.080627] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa is going to be created. [ 998.112337] env[70520]: INFO networking_nsxv3.common.synchronization [req-05c7250e-3ad9-4fe7-96dd-30573ad3123b req-45700006-7b68-445b-add3-0423f7a69c3a tempest-ImagesOneServerNegativeTestJSON-1115954637 tempest-ImagesOneServerNegativeTestJSON-1115954637-project-member] Enqueued Resource ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad with Priority: HIGHEST for action security_group_members [ 998.113179] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad with Priority: HIGHEST for action security_group_members [ 998.113856] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc3c352-f711-4ecc-9064-0883727ce3ad taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.114333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.115381] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.115678] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.115874] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.116255] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.116255] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.116420] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.116540] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.116659] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cc3c352-f711-4ecc-9064-0883727ce3ad',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.145795] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.145947] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.145988] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.146217] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.146392] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.159672] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa in Status: IN_PROGRESS for 2s [ 998.377753] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d3e2e95-1306-419d-a0f9-f4e048bfb7db: rpc.has_security_group_logging(os_id): False [ 998.399316] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.399502] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.399561] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.399772] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.399867] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.401134] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.401134] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.401134] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.401134] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.401134] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.401134] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.401134] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.401134] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.401134] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.401134] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.402266] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.402413] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.402482] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.402634] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.402764] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.402827] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db is going to be updated. [ 998.404517] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.454400] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.454556] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.454661] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.454966] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.455071] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.455330] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.455436] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.455499] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.455651] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.455763] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.455907] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 is going to be updated. [ 998.457716] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.457891] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.458035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.458253] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.459590] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.459699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.474908] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.475125] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.480745] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.481066] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.481294] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.481420] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.481891] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.481891] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.481891] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58197438-6dcb-404e-a8c1-aeacc2454958 is going to be updated. [ 998.483722] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.484144] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.512866] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.513189] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.513343] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.514012] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.514012] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.529731] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-918 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.529731] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-918" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.529961] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-918" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.530077] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-918" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.531214] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.531214] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.531214] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.531214] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.531636] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.532072] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 998.532072] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 998.532233] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 998.532269] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 998.534273] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 998.534273] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 998.534273] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 998.534475] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: IN_PROGRESS for 2s [ 998.547617] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.549525] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.549525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.549525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.549525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.549525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.549525] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cfd4659-cc60-4e40-83b3-09f036d8f58c is going to be updated. [ 998.549819] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.549819] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.549941] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.577716] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 998.577929] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.045 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 998.578119] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 998.578309] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-918" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.578649] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-aecb263d-0e20-4c84-bd9b-8032623236d5 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.578829] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-aecb263d-0e20-4c84-bd9b-8032623236d5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.578949] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-aecb263d-0e20-4c84-bd9b-8032623236d5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.579321] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-aecb263d-0e20-4c84-bd9b-8032623236d5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.579466] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aecb263d-0e20-4c84-bd9b-8032623236d5',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.586492] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: IN_PROGRESS for 2s [ 998.595386] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.595386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.595386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.595624] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.595624] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.604996] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58197438-6dcb-404e-a8c1-aeacc2454958 in Status: IN_PROGRESS for 2s [ 998.609864] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.610026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.610089] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.610294] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.610430] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.619351] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.619521] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.619564] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.619743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.621499] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cfd4659-cc60-4e40-83b3-09f036d8f58c in Status: IN_PROGRESS for 2s [ 998.657271] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.657570] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.657698] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.657830] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.658048] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.658185] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.658185] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad is going to be updated. [ 998.686810] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.686810] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.686810] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.687153] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.687231] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.697996] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad in Status: IN_PROGRESS for 2s [ 998.907822] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.086541] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.086541] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.086541] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.086541] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.086541] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.086541] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port aecb263d-0e20-4c84-bd9b-8032623236d5 not found, creating... [ 999.086541] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.086541] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.086541] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.086541] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.086541] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.087330] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.087330] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.087330] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.087330] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.087483] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.087611] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: aecb263d-0e20-4c84-bd9b-8032623236d5 is going to be created. [ 999.109456] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.109666] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.109838] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.110568] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.115148] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.116781] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-aecb263d-0e20-4c84-bd9b-8032623236d5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.410650] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.410976] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.410976] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.411573] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.411573] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.411573] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 is going to be updated. [ 999.439988] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.440170] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.440230] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.440442] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.440603] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.450933] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: IN_PROGRESS for 2s [ 999.803383] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: SUCCESS [ 999.803627] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.054267] env[70520]: INFO networking_nsxv3.common.synchronization [req-05c7250e-3ad9-4fe7-96dd-30573ad3123b req-f36f4173-8952-4ac8-9058-7322811a3f6e service nova] Enqueued Resource ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad with Priority: HIGHEST for action security_group_rules [ 1000.054267] env[70520]: INFO networking_nsxv3.common.synchronization [req-05c7250e-3ad9-4fe7-96dd-30573ad3123b req-f36f4173-8952-4ac8-9058-7322811a3f6e service nova] Enqueued Resource ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad with Priority: HIGHEST for action security_group_members [ 1000.054267] env[70520]: INFO networking_nsxv3.common.synchronization [req-05c7250e-3ad9-4fe7-96dd-30573ad3123b req-f36f4173-8952-4ac8-9058-7322811a3f6e service nova] Enqueued Resource ID: aecb263d-0e20-4c84-bd9b-8032623236d5 with Priority: HIGHEST for action port [ 1000.056982] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad with Priority: HIGHEST for action security_group_rules [ 1000.057278] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad with Priority: HIGHEST for action security_group_members [ 1000.057505] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aecb263d-0e20-4c84-bd9b-8032623236d5 with Priority: HIGHEST for action port [ 1000.058067] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cc3c352-f711-4ecc-9064-0883727ce3ad taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.058235] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.058268] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.060392] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.060586] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cc3c352-f711-4ecc-9064-0883727ce3ad',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.064088] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc3c352-f711-4ecc-9064-0883727ce3ad taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.064088] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.064088] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-aecb263d-0e20-4c84-bd9b-8032623236d5 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.064088] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aecb263d-0e20-4c84-bd9b-8032623236d5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.064088] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aecb263d-0e20-4c84-bd9b-8032623236d5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.064446] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aecb263d-0e20-4c84-bd9b-8032623236d5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.064631] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aecb263d-0e20-4c84-bd9b-8032623236d5',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.178578] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa in Status: SUCCESS [ 1000.179287] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.546070] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: IN_PROGRESS for 4s [ 1000.565667] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc3c352-f711-4ecc-9064-0883727ce3ad taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.565756] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.567301] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aecb263d-0e20-4c84-bd9b-8032623236d5 with status ACTIVE [ 1000.567505] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.567627] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.567689] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.567929] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.568165] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.568243] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.568336] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.568390] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.568535] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.568615] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.568772] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.568900] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.568900] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.569061] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.569135] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.569208] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aecb263d-0e20-4c84-bd9b-8032623236d5 is going to be updated. [ 1000.620609] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58197438-6dcb-404e-a8c1-aeacc2454958 in Status: SUCCESS [ 1000.620609] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58197438-6dcb-404e-a8c1-aeacc2454958 deletion is rescheduled due to dependency. [ 1000.620609] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.621408] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: SUCCESS [ 1000.621688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.624276] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.624452] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.624500] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.624681] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.624681] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.624681] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aecb263d-0e20-4c84-bd9b-8032623236d5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.633457] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cfd4659-cc60-4e40-83b3-09f036d8f58c in Status: SUCCESS [ 1000.633457] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cfd4659-cc60-4e40-83b3-09f036d8f58c deletion is rescheduled due to dependency. [ 1000.633457] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cfd4659-cc60-4e40-83b3-09f036d8f58c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.712473] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad in Status: SUCCESS [ 1000.712669] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad deletion is rescheduled due to dependency. [ 1000.712803] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.712933] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.713179] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.713442] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.713563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.713563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.713673] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.713828] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.713828] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cc3c352-f711-4ecc-9064-0883727ce3ad',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.216538] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3cc3c352-f711-4ecc-9064-0883727ce3ad',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.389889] env[70520]: INFO networking_nsxv3.common.synchronization [req-c413a83e-a3fa-4bb3-9292-4c51730deeaa req-edb34672-862f-4e81-99d2-960fbddbf501 tempest-MultipleCreateTestJSON-1344547532 tempest-MultipleCreateTestJSON-1344547532-project-member] Enqueued Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_members [ 1001.390492] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_members [ 1001.390798] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.390920] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.390988] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.391902] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.392056] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.392167] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.393583] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.393583] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.393583] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.393583] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.398277] env[70520]: INFO networking_nsxv3.common.synchronization [req-81c5e997-eaff-4e70-b122-ab583229d17e req-bc6aae89-9801-4848-95aa-1dd455cb3c85 tempest-MultipleCreateTestJSON-1344547532 tempest-MultipleCreateTestJSON-1344547532-project-member] Enqueued Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_members [ 1001.400348] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGHEST for action security_group_members [ 1001.400776] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.400776] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.461265] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: SUCCESS [ 1001.461513] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.570633] env[70520]: INFO networking_nsxv3.common.synchronization [req-15d80b87-a100-45bd-a0db-6082e78e5a5d req-c03772b2-3737-4394-aeb9-7ccb5bac8a8e tempest-MigrationsAdminTest-360924409 tempest-MigrationsAdminTest-360924409-project-member] Enqueued Resource ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 with Priority: HIGHEST for action security_group_members [ 1001.571174] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 with Priority: HIGHEST for action security_group_members [ 1001.571478] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f391db-1908-4d0d-afa1-a1da6f6944f6 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.571599] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.571665] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.571864] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.572184] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.572332] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.572396] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.572576] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.572663] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.572757] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17f391db-1908-4d0d-afa1-a1da6f6944f6',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.720736] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3cc3c352-f711-4ecc-9064-0883727ce3ad',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.896036] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.896036] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.896199] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.896304] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.896397] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.896597] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.896738] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.896738] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.897034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.897178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.897266] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db is going to be updated. [ 1001.947725] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.947904] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.948015] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.948320] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.948482] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.969383] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: IN_PROGRESS for 2s [ 1002.076168] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.076342] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.076434] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.076625] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.115569] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.115826] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.115953] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.116022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.116246] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.116387] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.116444] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 is going to be updated. [ 1002.173040] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.173040] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.173040] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.173040] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.173040] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.190022] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 in Status: IN_PROGRESS for 2s [ 1002.225226] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.225471] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.225471] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.225699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.225809] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.225878] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad is going to be updated. [ 1002.263142] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.263517] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.263610] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.263839] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.263991] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.273862] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad in Status: IN_PROGRESS for 2s [ 1002.529869] env[70520]: INFO networking_nsxv3.common.synchronization [req-fd81da09-fd9f-4731-ac11-180a1226c064 req-88b06cd6-249c-4eb1-b3e8-0f06352264eb tempest-ServerDiskConfigTestJSON-984450191 tempest-ServerDiskConfigTestJSON-984450191-project-member] Enqueued Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 1002.530436] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 1002.530745] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.530869] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.530927] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.531896] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.532117] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.532261] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.532345] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.532533] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.532645] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.532750] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.560285] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 in Status: SUCCESS [ 1002.560545] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b22ab11-3a43-4e3c-a9ac-8ee49b487341 deletion is rescheduled due to dependency. [ 1002.560690] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22ab11-3a43-4e3c-a9ac-8ee49b487341" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.035880] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.036201] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.036201] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.036325] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.036414] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.036608] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.036704] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.036767] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.036929] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.037015] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.037104] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 is going to be updated. [ 1003.069275] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.069275] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.069471] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.069598] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.069795] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.078900] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: IN_PROGRESS for 2s [ 1003.257840] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-265 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.257840] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-265" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.257840] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-265" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.258059] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-265" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.258349] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.258470] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.258572] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.259264] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.259436] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.259736] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1003.261235] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1003.261235] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1003.261235] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1003.261235] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1003.261235] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1003.261235] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1003.281235] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1003.281410] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1003.281565] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1003.281670] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-265" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.282029] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-1b107bc6-60d5-4575-93e4-c59ed1bd6c9d taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.282181] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-1b107bc6-60d5-4575-93e4-c59ed1bd6c9d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.282298] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-1b107bc6-60d5-4575-93e4-c59ed1bd6c9d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.282753] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-1b107bc6-60d5-4575-93e4-c59ed1bd6c9d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.282843] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b107bc6-60d5-4575-93e4-c59ed1bd6c9d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.446153] env[70520]: INFO networking_nsxv3.common.synchronization [None req-8a01db93-1ef9-45a3-9265-dda5a2688bec None None] Enqueued Resource ID: a3807797-d1a7-4a90-87e7-3bc212c4d072 with Priority: HIGHEST for action port [ 1003.446671] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3807797-d1a7-4a90-87e7-3bc212c4d072 with Priority: HIGHEST for action port [ 1003.446994] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3807797-d1a7-4a90-87e7-3bc212c4d072 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.447127] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3807797-d1a7-4a90-87e7-3bc212c4d072" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.447227] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3807797-d1a7-4a90-87e7-3bc212c4d072" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.447430] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3807797-d1a7-4a90-87e7-3bc212c4d072" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.447509] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3807797-d1a7-4a90-87e7-3bc212c4d072',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.786970] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.787529] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.787681] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.787981] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.788158] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.788324] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 1b107bc6-60d5-4575-93e4-c59ed1bd6c9d not found, creating... [ 1003.788594] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.788763] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.788883] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.789141] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.789335] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.789708] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.789881] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.790017] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.790339] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.790513] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.790690] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 1b107bc6-60d5-4575-93e4-c59ed1bd6c9d is going to be created. [ 1003.812194] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.812519] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.812679] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.812985] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.813246] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.815168] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-1b107bc6-60d5-4575-93e4-c59ed1bd6c9d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.951992] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a3807797-d1a7-4a90-87e7-3bc212c4d072 [ 1003.952317] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.953216] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.953216] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.953216] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.953216] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.953216] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a3807797-d1a7-4a90-87e7-3bc212c4d072 already deleted. [ 1003.953216] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3807797-d1a7-4a90-87e7-3bc212c4d072" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.979833] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: SUCCESS [ 1003.980121] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db deletion is rescheduled due to dependency. [ 1003.980698] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.981473] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.981731] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.981961] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.982901] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.983495] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.983737] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.983921] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.984022] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.199612] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 in Status: SUCCESS [ 1004.199897] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17f391db-1908-4d0d-afa1-a1da6f6944f6 deletion is rescheduled due to dependency. [ 1004.199934] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f391db-1908-4d0d-afa1-a1da6f6944f6" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.285789] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad in Status: SUCCESS [ 1004.286028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.286224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.286432] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.286629] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.289074] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.289074] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.289074] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.289074] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.289074] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.289074] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3cc3c352-f711-4ecc-9064-0883727ce3ad',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.491043] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.491043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.491043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.491043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.491043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.491043] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.491043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.491043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.491043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.491043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.491043] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db is going to be updated. [ 1004.517378] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.518066] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.518276] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.518587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.519210] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.528866] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: IN_PROGRESS for 2s [ 1004.635429] env[70520]: INFO networking_nsxv3.common.synchronization [req-fd81da09-fd9f-4731-ac11-180a1226c064 req-e1b3d32d-50a1-43b8-8afb-f79467c11852 service nova] Enqueued Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_rules [ 1004.635429] env[70520]: INFO networking_nsxv3.common.synchronization [req-fd81da09-fd9f-4731-ac11-180a1226c064 req-e1b3d32d-50a1-43b8-8afb-f79467c11852 service nova] Enqueued Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 1004.635429] env[70520]: INFO networking_nsxv3.common.synchronization [req-fd81da09-fd9f-4731-ac11-180a1226c064 req-e1b3d32d-50a1-43b8-8afb-f79467c11852 service nova] Enqueued Resource ID: 1b107bc6-60d5-4575-93e4-c59ed1bd6c9d with Priority: HIGHEST for action port [ 1004.635429] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_rules [ 1004.635429] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 1004.635429] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b107bc6-60d5-4575-93e4-c59ed1bd6c9d with Priority: HIGHEST for action port [ 1004.635429] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.635429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.635429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.636316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.636316] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.636771] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.637090] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.637163] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b107bc6-60d5-4575-93e4-c59ed1bd6c9d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.637234] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b107bc6-60d5-4575-93e4-c59ed1bd6c9d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.637275] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b107bc6-60d5-4575-93e4-c59ed1bd6c9d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.637481] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b107bc6-60d5-4575-93e4-c59ed1bd6c9d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.637567] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b107bc6-60d5-4575-93e4-c59ed1bd6c9d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.790499] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc3c352-f711-4ecc-9064-0883727ce3ad taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.790674] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.790755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.790950] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.791122] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.791219] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.791279] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.791421] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.791505] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.791588] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.791727] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc3c352-f711-4ecc-9064-0883727ce3ad taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.791816] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.791874] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.792015] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.792159] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.792248] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.792304] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.792437] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.792512] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.792616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.792683] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3cc3c352-f711-4ecc-9064-0883727ce3ad',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.091237] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: SUCCESS [ 1005.094461] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 deletion is rescheduled due to dependency. [ 1005.094832] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.095203] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.095702] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.095940] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.096143] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.096572] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.096572] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.096572] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.096703] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.142190] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.142299] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.143109] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b107bc6-60d5-4575-93e4-c59ed1bd6c9d with status ACTIVE [ 1005.143109] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.143109] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.143109] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.144752] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.144752] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.144752] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.144752] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.146133] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.146133] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.146133] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.146133] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.146405] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.146543] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.146714] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.146851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.147019] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b107bc6-60d5-4575-93e4-c59ed1bd6c9d is going to be updated. [ 1005.178786] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.178936] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.178996] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.179226] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.179362] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.179517] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b107bc6-60d5-4575-93e4-c59ed1bd6c9d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.298930] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3cc3c352-f711-4ecc-9064-0883727ce3ad: rpc.has_security_group_logging(os_id): False [ 1005.323029] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.323029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.323029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.323029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.323029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.323029] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.323029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.323029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.323029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.323029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.323029] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.323029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.323029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.323029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.323029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.323747] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.323747] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.323747] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.324595] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.324855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.325770] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad is going to be updated. [ 1005.417811] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.419562] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.421108] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.421108] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.421108] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.437599] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad in Status: IN_PROGRESS for 2s [ 1005.600948] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.960123] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-28 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.960400] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-28" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.960493] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-28" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.960813] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-28" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.961100] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.961264] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.961385] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.961605] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.961751] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.961974] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1005.962217] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1005.962404] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1005.962482] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1005.962566] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1005.962671] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1005.962803] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1005.985762] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1005.985986] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1005.985986] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1005.986143] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-28" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.986489] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-21efc286-0a0e-4447-a667-9c5bf1fe5417 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.986660] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-21efc286-0a0e-4447-a667-9c5bf1fe5417" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.986780] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-21efc286-0a0e-4447-a667-9c5bf1fe5417" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.987208] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-21efc286-0a0e-4447-a667-9c5bf1fe5417" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.987317] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21efc286-0a0e-4447-a667-9c5bf1fe5417',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.992033] env[70520]: INFO networking_nsxv3.common.synchronization [None req-f796a33a-aeab-48c4-81ad-9a31d5b4aec1 None None] Enqueued Resource ID: 70748617-feba-4712-a181-89d44c2e7476 with Priority: HIGHEST for action port [ 1005.992281] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70748617-feba-4712-a181-89d44c2e7476 with Priority: HIGHEST for action port [ 1005.992850] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-70748617-feba-4712-a181-89d44c2e7476 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.993027] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70748617-feba-4712-a181-89d44c2e7476" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.993071] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70748617-feba-4712-a181-89d44c2e7476" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.993289] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70748617-feba-4712-a181-89d44c2e7476" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.993369] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70748617-feba-4712-a181-89d44c2e7476',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.104377] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.495040] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.495040] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.495040] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.495040] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.495654] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.495654] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.495654] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.495826] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.495993] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.496144] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.496422] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.496785] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.496785] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.496935] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.497446] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.498166] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 21efc286-0a0e-4447-a667-9c5bf1fe5417 is going to be updated. [ 1006.499572] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 70748617-feba-4712-a181-89d44c2e7476 [ 1006.499750] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.499851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.499920] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.500078] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.500158] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.500241] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:70748617-feba-4712-a181-89d44c2e7476 already deleted. [ 1006.500319] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70748617-feba-4712-a181-89d44c2e7476" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.503087] env[70520]: INFO networking_nsxv3.common.synchronization [None req-ac0d9ce7-acd7-40d2-86be-a4c39e5f57a0 None None] Enqueued Resource ID: 6ecd4d7a-852e-4907-9652-153fd0daca16 with Priority: HIGHEST for action port [ 1006.503873] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ecd4d7a-852e-4907-9652-153fd0daca16 with Priority: HIGHEST for action port [ 1006.504189] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ecd4d7a-852e-4907-9652-153fd0daca16 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.504317] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ecd4d7a-852e-4907-9652-153fd0daca16" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.504380] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ecd4d7a-852e-4907-9652-153fd0daca16" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.504648] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ecd4d7a-852e-4907-9652-153fd0daca16" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.504719] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ecd4d7a-852e-4907-9652-153fd0daca16',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.524542] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.524834] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.525068] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.525660] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.525874] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.525948] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-21efc286-0a0e-4447-a667-9c5bf1fe5417" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.539704] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: IN_PROGRESS for 4s [ 1006.610133] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.610346] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.610424] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.610634] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.610726] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.610824] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 is going to be updated. [ 1006.652143] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.652412] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.652412] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.652590] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.652759] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.682178] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: IN_PROGRESS for 2s [ 1006.700655] env[70520]: INFO networking_nsxv3.common.synchronization [req-177da379-a29e-45e9-9b45-2d0ed63e635a req-f8921212-7570-41cb-87ab-26e4766272a8 tempest-AttachInterfacesTestJSON-1687744298 tempest-AttachInterfacesTestJSON-1687744298-project-member] Enqueued Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_members [ 1006.701351] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_members [ 1006.701687] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.701810] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.701867] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.704827] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.704827] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.704827] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.704827] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.704827] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.704827] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.704827] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.008294] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ecd4d7a-852e-4907-9652-153fd0daca16 [ 1007.008294] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.008294] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.008294] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.008294] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.008294] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.008294] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ecd4d7a-852e-4907-9652-153fd0daca16 already deleted. [ 1007.008671] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ecd4d7a-852e-4907-9652-153fd0daca16" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.206742] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.207850] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.208136] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.208508] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.208697] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.209061] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.209302] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.209448] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.211052] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.211052] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.211052] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a is going to be updated. [ 1007.248487] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.248487] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.248487] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.248487] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.248487] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.255649] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: IN_PROGRESS for 2s [ 1007.452278] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad in Status: SUCCESS [ 1007.454457] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.480335] env[70520]: INFO networking_nsxv3.common.synchronization [None req-e4114350-9878-4914-9f7b-4c3ebc44622b tempest-AttachVolumeTestJSON-1760709661 tempest-AttachVolumeTestJSON-1760709661-project-member] Enqueued Resource ID: ed51a6f5-8537-40e6-9b09-ff216cb9a61d with Priority: HIGHEST for action security_group_rules [ 1007.483202] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed51a6f5-8537-40e6-9b09-ff216cb9a61d with Priority: HIGHEST for action security_group_rules [ 1007.483889] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed51a6f5-8537-40e6-9b09-ff216cb9a61d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.483889] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed51a6f5-8537-40e6-9b09-ff216cb9a61d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.483889] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed51a6f5-8537-40e6-9b09-ff216cb9a61d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.484155] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed51a6f5-8537-40e6-9b09-ff216cb9a61d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.484680] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed51a6f5-8537-40e6-9b09-ff216cb9a61d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.590445] env[70520]: INFO networking_nsxv3.common.synchronization [None req-55a426e6-72c5-4391-a468-a91f6605705d tempest-AttachVolumeTestJSON-1760709661 tempest-AttachVolumeTestJSON-1760709661-project-member] Enqueued Resource ID: ed51a6f5-8537-40e6-9b09-ff216cb9a61d with Priority: HIGHEST for action security_group_rules [ 1007.590909] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed51a6f5-8537-40e6-9b09-ff216cb9a61d with Priority: HIGHEST for action security_group_rules [ 1007.591274] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed51a6f5-8537-40e6-9b09-ff216cb9a61d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.591376] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed51a6f5-8537-40e6-9b09-ff216cb9a61d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.610627] env[70520]: INFO networking_nsxv3.common.synchronization [req-974c2c21-613f-43a2-aa16-4d60ea960afd req-acb9d07a-6e0b-4dac-9d0a-87b67c7244d4 service nova] Enqueued Resource ID: d202bbfa-42d6-4633-985f-b1007599bbf2 with Priority: HIGHEST for action security_group_rules [ 1007.610842] env[70520]: INFO networking_nsxv3.common.synchronization [req-974c2c21-613f-43a2-aa16-4d60ea960afd req-acb9d07a-6e0b-4dac-9d0a-87b67c7244d4 service nova] Enqueued Resource ID: d202bbfa-42d6-4633-985f-b1007599bbf2 with Priority: HIGHEST for action security_group_members [ 1007.611054] env[70520]: INFO networking_nsxv3.common.synchronization [req-974c2c21-613f-43a2-aa16-4d60ea960afd req-acb9d07a-6e0b-4dac-9d0a-87b67c7244d4 service nova] Enqueued Resource ID: 21efc286-0a0e-4447-a667-9c5bf1fe5417 with Priority: HIGHEST for action port [ 1007.611666] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d202bbfa-42d6-4633-985f-b1007599bbf2 with Priority: HIGHEST for action security_group_rules [ 1007.611847] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d202bbfa-42d6-4633-985f-b1007599bbf2 with Priority: HIGHEST for action security_group_members [ 1007.611993] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21efc286-0a0e-4447-a667-9c5bf1fe5417 with Priority: HIGHEST for action port [ 1007.616394] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d202bbfa-42d6-4633-985f-b1007599bbf2 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.616551] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.616624] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.616878] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.617029] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d202bbfa-42d6-4633-985f-b1007599bbf2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.618200] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d202bbfa-42d6-4633-985f-b1007599bbf2 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.618352] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.618441] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.622894] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.622894] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.622894] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.622894] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.622894] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.622894] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.622894] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d202bbfa-42d6-4633-985f-b1007599bbf2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.622894] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-21efc286-0a0e-4447-a667-9c5bf1fe5417 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.622894] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21efc286-0a0e-4447-a667-9c5bf1fe5417" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.622894] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21efc286-0a0e-4447-a667-9c5bf1fe5417" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.622894] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21efc286-0a0e-4447-a667-9c5bf1fe5417" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.622894] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21efc286-0a0e-4447-a667-9c5bf1fe5417',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.011307] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.011307] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.011307] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.011515] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.011587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.014111] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed51a6f5-8537-40e6-9b09-ff216cb9a61d already deleted. [ 1008.014111] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed51a6f5-8537-40e6-9b09-ff216cb9a61d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.014111] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed51a6f5-8537-40e6-9b09-ff216cb9a61d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.014111] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed51a6f5-8537-40e6-9b09-ff216cb9a61d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.014111] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed51a6f5-8537-40e6-9b09-ff216cb9a61d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.123745] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d202bbfa-42d6-4633-985f-b1007599bbf2 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.124197] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.124197] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21efc286-0a0e-4447-a667-9c5bf1fe5417 with status ACTIVE [ 1008.124342] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.124415] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.124471] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.124692] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.124806] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.124988] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.125112] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.125157] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.125319] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.125394] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.125582] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.125674] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.125734] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.125881] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.125953] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.126054] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21efc286-0a0e-4447-a667-9c5bf1fe5417 is going to be updated. [ 1008.127787] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d202bbfa-42d6-4633-985f-b1007599bbf2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.154796] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.155096] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.155329] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.155682] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.155968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.156216] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21efc286-0a0e-4447-a667-9c5bf1fe5417" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.534301] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.534503] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.534503] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.537437] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.537437] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.537437] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed51a6f5-8537-40e6-9b09-ff216cb9a61d already deleted. [ 1008.537437] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed51a6f5-8537-40e6-9b09-ff216cb9a61d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.551087] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db in Status: SUCCESS [ 1008.551289] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db deletion is rescheduled due to dependency. [ 1008.551403] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.631022] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d202bbfa-42d6-4633-985f-b1007599bbf2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.694231] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: SUCCESS [ 1008.694231] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.694231] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.694231] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.694231] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.694676] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.694676] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.694676] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.694676] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.694893] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.694893] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.037488] env[70520]: INFO networking_nsxv3.common.synchronization [None req-eeef3c0d-43e7-4fcf-97f8-76f0558e416c None None] Enqueued Resource ID: 3489b12f-b75a-4d53-a673-b02ea42fdf12 with Priority: HIGHEST for action port [ 1009.038106] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3489b12f-b75a-4d53-a673-b02ea42fdf12 with Priority: HIGHEST for action port [ 1009.038433] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-3489b12f-b75a-4d53-a673-b02ea42fdf12 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.038553] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3489b12f-b75a-4d53-a673-b02ea42fdf12" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.038610] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3489b12f-b75a-4d53-a673-b02ea42fdf12" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.039596] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3489b12f-b75a-4d53-a673-b02ea42fdf12" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.039648] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3489b12f-b75a-4d53-a673-b02ea42fdf12',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.134417] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.134829] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.134991] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.135196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.135325] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.135394] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d202bbfa-42d6-4633-985f-b1007599bbf2 is going to be updated. [ 1009.168361] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.168619] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.168619] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.168841] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.169063] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.179934] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d202bbfa-42d6-4633-985f-b1007599bbf2 in Status: IN_PROGRESS for 2s [ 1009.200223] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.200431] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.200472] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.200677] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.200844] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.200946] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.201045] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.201216] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.201306] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.203992] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.203992] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.203992] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.203992] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.203992] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.203992] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.203992] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.203992] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.203992] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.203992] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.203992] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.203992] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.265951] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: SUCCESS [ 1009.266136] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a deletion is rescheduled due to dependency. [ 1009.266246] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.543061] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3489b12f-b75a-4d53-a673-b02ea42fdf12 [ 1009.543410] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.543559] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.543610] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.543824] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.544420] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.544420] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3489b12f-b75a-4d53-a673-b02ea42fdf12 already deleted. [ 1009.544420] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3489b12f-b75a-4d53-a673-b02ea42fdf12" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.706515] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a23aa860-12db-4b07-ac46-cf4709db7164: rpc.has_security_group_logging(os_id): False [ 1009.726574] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.728755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.728755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.728755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.728755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.728755] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.728755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.728755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.728755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.728755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.728755] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.728755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.728755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.728755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.728755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.729326] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.729326] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.729326] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.729326] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.729326] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.729326] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 is going to be updated. [ 1009.798889] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.799047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.799125] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.799669] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.799886] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.815847] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: IN_PROGRESS for 2s [ 1010.267896] env[70520]: INFO networking_nsxv3.common.synchronization [req-20f3c4da-461b-42a5-be07-0de098953cea req-4c1a158a-b684-4842-b613-d0550cdd7dfe tempest-DeleteServersTestJSON-1399047283 tempest-DeleteServersTestJSON-1399047283-project-member] Enqueued Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 1010.268506] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 1010.268809] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.269060] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.270871] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.271169] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.271348] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.271457] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.271514] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.271674] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.271758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.271898] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.574925] env[70520]: INFO networking_nsxv3.common.synchronization [req-22f5d0b9-8ae7-4bef-9bd9-f0034038cdc8 req-ce4488e6-9f9d-4f5b-b1c8-acbb24ebda4d tempest-AttachInterfacesTestJSON-1687744298 tempest-AttachInterfacesTestJSON-1687744298-project-member] Enqueued Resource ID: 0775b802-20d8-4210-ad0d-b621a7b66c62 with Priority: HIGHEST for action security_group_members [ 1010.575511] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0775b802-20d8-4210-ad0d-b621a7b66c62 with Priority: HIGHEST for action security_group_members [ 1010.575833] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-0775b802-20d8-4210-ad0d-b621a7b66c62 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.576151] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.576151] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.576291] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.576452] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.576555] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.576619] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.576774] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.576859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.576970] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0775b802-20d8-4210-ad0d-b621a7b66c62',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.776196] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.776488] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.776488] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.776569] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.776627] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.776841] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.777036] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.777095] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.777438] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.777438] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.777438] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f is going to be updated. [ 1010.808954] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.809210] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.809496] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.809730] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.809879] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.819571] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: IN_PROGRESS for 2s [ 1011.081555] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.081555] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.081555] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.081555] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.101335] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.101782] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.102607] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.102607] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.102607] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.102607] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.102607] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0775b802-20d8-4210-ad0d-b621a7b66c62 is going to be updated. [ 1011.132832] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.133015] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.133074] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.134252] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.134493] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.148604] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0775b802-20d8-4210-ad0d-b621a7b66c62 in Status: IN_PROGRESS for 2s [ 1011.189346] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d202bbfa-42d6-4633-985f-b1007599bbf2 in Status: SUCCESS [ 1011.189613] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.189784] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.191116] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.191116] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.191116] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.191116] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.191116] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.191116] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.191116] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.191116] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d202bbfa-42d6-4633-985f-b1007599bbf2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.427587] env[70520]: INFO networking_nsxv3.common.synchronization [req-73e66923-9fe7-41ab-9f30-db5dcd7716e1 req-07c60118-b7d9-45d7-aff0-5d8a72ec429b tempest-ImagesOneServerNegativeTestJSON-1115954637 tempest-ImagesOneServerNegativeTestJSON-1115954637-project-member] Enqueued Resource ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad with Priority: HIGHEST for action security_group_members [ 1011.428568] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad with Priority: HIGHEST for action security_group_members [ 1011.428691] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc3c352-f711-4ecc-9064-0883727ce3ad taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.428880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.428978] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.430069] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.430069] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.430069] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.430069] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.430069] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.430069] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.430069] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cc3c352-f711-4ecc-9064-0883727ce3ad',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.694140] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d202bbfa-42d6-4633-985f-b1007599bbf2 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.694140] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.694140] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.694140] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.694140] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.694140] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.694140] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.694140] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.694572] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.694572] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.694572] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d202bbfa-42d6-4633-985f-b1007599bbf2 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.694572] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.694572] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.694710] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.694792] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.694910] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.694995] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.695150] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.695224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.695305] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.695390] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d202bbfa-42d6-4633-985f-b1007599bbf2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.836022] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: SUCCESS [ 1011.836022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.935026] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.935026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.935026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.935026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.935026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.935026] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.935026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.935026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.935026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.935026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.935026] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad is going to be updated. [ 1011.981178] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.981178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.981178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.981178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.981178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.994784] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad in Status: IN_PROGRESS for 2s [ 1012.199896] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d202bbfa-42d6-4633-985f-b1007599bbf2: rpc.has_security_group_logging(os_id): False [ 1012.217672] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.217672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.217848] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.218222] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.237153] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.237442] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.237563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.237628] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.237841] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.237922] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.238149] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.238256] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.238315] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.238464] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.238537] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.238720] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.238812] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.238873] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.239034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.239111] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.239195] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d202bbfa-42d6-4633-985f-b1007599bbf2 is going to be updated. [ 1012.303336] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.303551] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.303634] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.303868] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.304298] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.319115] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d202bbfa-42d6-4633-985f-b1007599bbf2 in Status: IN_PROGRESS for 2s [ 1012.834307] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: SUCCESS [ 1012.834503] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f deletion is rescheduled due to dependency. [ 1012.834620] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.162609] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0775b802-20d8-4210-ad0d-b621a7b66c62 in Status: SUCCESS [ 1013.162905] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0775b802-20d8-4210-ad0d-b621a7b66c62 deletion is rescheduled due to dependency. [ 1013.163022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.380671] env[70520]: INFO networking_nsxv3.common.synchronization [req-363beafc-24f8-47f6-9290-3b68326dfc9c req-f3b1232c-d0c5-4987-8aae-121e5841d22d tempest-ServersTestMultiNic-541139820 tempest-ServersTestMultiNic-541139820-project-member] Enqueued Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1013.383173] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1013.383591] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.383752] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.383823] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.384697] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.384865] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.385187] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.385187] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.385305] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.385363] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.385492] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.872527] env[70520]: INFO networking_nsxv3.common.synchronization [req-363beafc-24f8-47f6-9290-3b68326dfc9c req-4d6c2fb1-5f7b-4915-b2ba-839a45becac4 tempest-ServersTestMultiNic-541139820 tempest-ServersTestMultiNic-541139820-project-member] Enqueued Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1013.873105] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1013.873443] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.873545] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.888504] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.888654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.888713] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.888972] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.889132] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.889376] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.889477] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.889521] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.889691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.889773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.889866] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a238fd65-d476-4f25-8c29-5e2babcc5026 already deleted. [ 1013.889948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.890457] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.890611] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.890759] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.890852] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.890912] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.891100] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.891173] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.891258] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.006348] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad in Status: SUCCESS [ 1014.006348] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad deletion is rescheduled due to dependency. [ 1014.006520] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.209249] env[70520]: INFO networking_nsxv3.common.synchronization [req-363beafc-24f8-47f6-9290-3b68326dfc9c req-c1bc1705-1ae9-4421-8470-f978cb050522 tempest-ServersTestMultiNic-541139820 tempest-ServersTestMultiNic-541139820-project-member] Enqueued Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1014.210836] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1014.211182] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.211283] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.336558] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d202bbfa-42d6-4633-985f-b1007599bbf2 in Status: SUCCESS [ 1014.336848] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.393085] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.393356] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.393356] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.393638] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.393638] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.393884] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.394011] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.394011] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.394465] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.394465] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.394465] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a238fd65-d476-4f25-8c29-5e2babcc5026 already deleted. [ 1014.394465] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.394675] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.394675] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.394834] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.394990] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.395071] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.395536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.395536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.395536] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.562692] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-234 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.562906] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-234" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.563226] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-234" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.563592] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-234" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.563856] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.564025] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.564150] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.564383] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.564534] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.564749] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1014.564874] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1014.565309] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1014.565309] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1014.565433] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1014.565433] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1014.565561] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1014.590901] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1014.591213] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1014.591430] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1014.591627] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-234" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.591993] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-f5c2d625-eeb6-4364-8171-448713a2960f taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.592202] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-f5c2d625-eeb6-4364-8171-448713a2960f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.592325] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-f5c2d625-eeb6-4364-8171-448713a2960f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.592655] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-f5c2d625-eeb6-4364-8171-448713a2960f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.592814] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5c2d625-eeb6-4364-8171-448713a2960f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.899679] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.899679] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.899679] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.899679] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.899679] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.899679] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.899679] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.899679] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.899679] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.899679] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.899679] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a238fd65-d476-4f25-8c29-5e2babcc5026 already deleted. [ 1014.899679] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.096114] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.096405] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.096405] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.096634] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.096785] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.096944] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port f5c2d625-eeb6-4364-8171-448713a2960f not found, creating... [ 1015.097367] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.097544] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.097748] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.098248] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.098248] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.098525] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.098689] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.098808] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.099048] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.099194] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.099343] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: f5c2d625-eeb6-4364-8171-448713a2960f is going to be created. [ 1015.125144] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.125476] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.125534] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.125906] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.126090] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.126457] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-f5c2d625-eeb6-4364-8171-448713a2960f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.969761] env[70520]: INFO networking_nsxv3.common.synchronization [req-7ae111fc-8a92-4443-ba6f-12779e9932cc req-48f07280-5c88-4aa6-9da0-a434ee4c914e tempest-ServerRescueTestJSON-1210437654 tempest-ServerRescueTestJSON-1210437654-project-member] Enqueued Resource ID: 58550c6c-a09f-469c-981b-0404b38bdf5d with Priority: HIGHEST for action security_group_members [ 1015.971429] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58550c6c-a09f-469c-981b-0404b38bdf5d with Priority: HIGHEST for action security_group_members [ 1015.971978] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-58550c6c-a09f-469c-981b-0404b38bdf5d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.972696] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.972696] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.972696] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.972841] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.972955] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.973030] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.973212] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.973324] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.973424] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58550c6c-a09f-469c-981b-0404b38bdf5d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.057414] env[70520]: INFO networking_nsxv3.common.synchronization [req-363beafc-24f8-47f6-9290-3b68326dfc9c req-6547725a-c56c-4e91-b741-bdef7cde530a service nova] Enqueued Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_rules [ 1016.061352] env[70520]: INFO networking_nsxv3.common.synchronization [req-363beafc-24f8-47f6-9290-3b68326dfc9c req-6547725a-c56c-4e91-b741-bdef7cde530a service nova] Enqueued Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1016.061352] env[70520]: INFO networking_nsxv3.common.synchronization [req-363beafc-24f8-47f6-9290-3b68326dfc9c req-6547725a-c56c-4e91-b741-bdef7cde530a service nova] Enqueued Resource ID: f5c2d625-eeb6-4364-8171-448713a2960f with Priority: HIGHEST for action port [ 1016.061352] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_rules [ 1016.061352] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1016.061352] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5c2d625-eeb6-4364-8171-448713a2960f with Priority: HIGHEST for action port [ 1016.061352] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.061352] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.061352] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.061352] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.061352] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.061694] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.061694] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.061780] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.062219] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.062469] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.062624] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.062700] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.066511] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.066511] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.066511] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.066511] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5c2d625-eeb6-4364-8171-448713a2960f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.066511] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5c2d625-eeb6-4364-8171-448713a2960f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.066511] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5c2d625-eeb6-4364-8171-448713a2960f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.066511] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5c2d625-eeb6-4364-8171-448713a2960f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.066511] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5c2d625-eeb6-4364-8171-448713a2960f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.397817] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-335 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.398038] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-335" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.398172] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-335" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.398439] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-335" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.398698] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.398854] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.398970] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.399204] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.399437] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.399572] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1016.399712] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1016.399789] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1016.399897] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1016.400019] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1016.400124] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1016.400260] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1016.422279] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1016.422279] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1016.422279] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1016.422414] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-335" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.422639] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-f868f59b-04a6-40c8-a3e0-ef9a387f6de1 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.423229] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-f868f59b-04a6-40c8-a3e0-ef9a387f6de1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.423229] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-f868f59b-04a6-40c8-a3e0-ef9a387f6de1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.423415] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-f868f59b-04a6-40c8-a3e0-ef9a387f6de1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.423551] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f868f59b-04a6-40c8-a3e0-ef9a387f6de1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.475403] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.475567] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.475619] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.475855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.475920] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.477543] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.477543] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.477543] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.477543] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.477543] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.477543] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58550c6c-a09f-469c-981b-0404b38bdf5d already deleted. [ 1016.477543] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.562209] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.562398] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.567772] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.572302] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f5c2d625-eeb6-4364-8171-448713a2960f with status ACTIVE [ 1016.572582] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.572728] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.572728] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.572935] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.573042] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.573236] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.573370] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.573407] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.573547] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.573621] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.573801] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.573892] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.573953] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.574108] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.574171] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.574257] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f5c2d625-eeb6-4364-8171-448713a2960f is going to be updated. [ 1016.601583] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.601772] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.601877] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.602204] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.602347] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.602554] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5c2d625-eeb6-4364-8171-448713a2960f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.926583] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.926583] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.926774] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.927069] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.927253] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.927417] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port f868f59b-04a6-40c8-a3e0-ef9a387f6de1 not found, creating... [ 1016.927692] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.927858] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.928031] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.928291] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.928437] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.928725] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.928884] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.929027] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.929227] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.929361] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.929589] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: f868f59b-04a6-40c8-a3e0-ef9a387f6de1 is going to be created. [ 1016.954494] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.954829] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.954925] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.955255] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.955589] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.955924] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-f868f59b-04a6-40c8-a3e0-ef9a387f6de1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.073243] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.145777] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-355 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.146050] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-355" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.146191] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-355" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.146564] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-355" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.146858] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.147058] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.147195] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.147427] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.147575] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.147789] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1017.147904] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1017.148047] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1017.148208] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1017.148337] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1017.148448] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1017.148582] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1017.171716] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1017.171949] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1017.172160] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1017.172378] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-355" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.172753] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-0357b508-27d6-4922-abcc-e652c38b86f1 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.172947] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-0357b508-27d6-4922-abcc-e652c38b86f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.173147] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-0357b508-27d6-4922-abcc-e652c38b86f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.173424] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-0357b508-27d6-4922-abcc-e652c38b86f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.173568] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0357b508-27d6-4922-abcc-e652c38b86f1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.575817] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.575973] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.576060] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.576291] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.576382] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.576541] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a238fd65-d476-4f25-8c29-5e2babcc5026 is going to be created. [ 1017.602555] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.602555] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.602671] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.602810] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.602968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.616718] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: UNINITIALIZED for 2s [ 1017.675720] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.675969] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.676218] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.676561] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.676561] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.676723] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 0357b508-27d6-4922-abcc-e652c38b86f1 not found, creating... [ 1017.677035] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.677203] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.677324] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.677558] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.677734] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.677984] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.678652] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.678652] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.678756] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.678833] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.679141] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 0357b508-27d6-4922-abcc-e652c38b86f1 is going to be created. [ 1017.709114] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.709114] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.709114] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.709114] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.709114] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.709114] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-0357b508-27d6-4922-abcc-e652c38b86f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.733684] env[70520]: INFO networking_nsxv3.common.synchronization [req-7ae111fc-8a92-4443-ba6f-12779e9932cc req-b27a03a0-c490-4faa-9ca4-10bcc8423510 service nova] Enqueued Resource ID: 58550c6c-a09f-469c-981b-0404b38bdf5d with Priority: HIGHEST for action security_group_rules [ 1017.733915] env[70520]: INFO networking_nsxv3.common.synchronization [req-7ae111fc-8a92-4443-ba6f-12779e9932cc req-b27a03a0-c490-4faa-9ca4-10bcc8423510 service nova] Enqueued Resource ID: 58550c6c-a09f-469c-981b-0404b38bdf5d with Priority: HIGHEST for action security_group_members [ 1017.734087] env[70520]: INFO networking_nsxv3.common.synchronization [req-7ae111fc-8a92-4443-ba6f-12779e9932cc req-b27a03a0-c490-4faa-9ca4-10bcc8423510 service nova] Enqueued Resource ID: f868f59b-04a6-40c8-a3e0-ef9a387f6de1 with Priority: HIGHEST for action port [ 1017.734656] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58550c6c-a09f-469c-981b-0404b38bdf5d with Priority: HIGHEST for action security_group_rules [ 1017.734792] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58550c6c-a09f-469c-981b-0404b38bdf5d with Priority: HIGHEST for action security_group_members [ 1017.734893] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f868f59b-04a6-40c8-a3e0-ef9a387f6de1 with Priority: HIGHEST for action port [ 1017.735228] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58550c6c-a09f-469c-981b-0404b38bdf5d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.735390] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.735437] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.735669] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.735751] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58550c6c-a09f-469c-981b-0404b38bdf5d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.736686] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-58550c6c-a09f-469c-981b-0404b38bdf5d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.737479] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.737479] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.737479] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.737479] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.737479] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.737479] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.737698] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.737698] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.737757] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58550c6c-a09f-469c-981b-0404b38bdf5d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.738562] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-f868f59b-04a6-40c8-a3e0-ef9a387f6de1 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.738656] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f868f59b-04a6-40c8-a3e0-ef9a387f6de1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.738707] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f868f59b-04a6-40c8-a3e0-ef9a387f6de1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.739680] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f868f59b-04a6-40c8-a3e0-ef9a387f6de1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.739680] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f868f59b-04a6-40c8-a3e0-ef9a387f6de1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.240729] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-58550c6c-a09f-469c-981b-0404b38bdf5d taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.244020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.244020] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58550c6c-a09f-469c-981b-0404b38bdf5d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.244020] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f868f59b-04a6-40c8-a3e0-ef9a387f6de1 with status ACTIVE [ 1018.244020] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.244020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.244020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.244020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.244020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.244020] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.244020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.244020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.244020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.244020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.245205] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.245435] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.245647] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.245886] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.246274] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.247748] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f868f59b-04a6-40c8-a3e0-ef9a387f6de1 is going to be updated. [ 1018.268940] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.269117] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.269117] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.269332] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.269481] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.269712] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f868f59b-04a6-40c8-a3e0-ef9a387f6de1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.450062] env[70520]: INFO networking_nsxv3.common.synchronization [req-363beafc-24f8-47f6-9290-3b68326dfc9c req-9c96a2c2-7c6c-44fa-8e65-2d96e2db9510 service nova] Enqueued Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_rules [ 1018.450284] env[70520]: INFO networking_nsxv3.common.synchronization [req-363beafc-24f8-47f6-9290-3b68326dfc9c req-9c96a2c2-7c6c-44fa-8e65-2d96e2db9510 service nova] Enqueued Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1018.450429] env[70520]: INFO networking_nsxv3.common.synchronization [req-363beafc-24f8-47f6-9290-3b68326dfc9c req-9c96a2c2-7c6c-44fa-8e65-2d96e2db9510 service nova] Enqueued Resource ID: 0357b508-27d6-4922-abcc-e652c38b86f1 with Priority: HIGHEST for action port [ 1018.450665] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_rules [ 1018.450791] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1018.450885] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0357b508-27d6-4922-abcc-e652c38b86f1 with Priority: HIGHEST for action port [ 1018.455193] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.455193] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.455193] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.455193] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.455193] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-0357b508-27d6-4922-abcc-e652c38b86f1 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.455193] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0357b508-27d6-4922-abcc-e652c38b86f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.455193] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0357b508-27d6-4922-abcc-e652c38b86f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.455193] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0357b508-27d6-4922-abcc-e652c38b86f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.455193] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0357b508-27d6-4922-abcc-e652c38b86f1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.455193] env[70520]: INFO networking_nsxv3.common.synchronization [req-2c585c3a-859f-423f-ab6c-c83367f31b92 req-4f7c4e5a-7941-4f70-89bf-1b9c538e5603 tempest-ImagesTestJSON-1211196503 tempest-ImagesTestJSON-1211196503-project-member] Enqueued Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1018.456105] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1018.456423] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.456566] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.456655] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.456907] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.457181] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.457248] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.457326] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.457502] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.457648] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.457777] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.752467] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58550c6c-a09f-469c-981b-0404b38bdf5d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.910353] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-29 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.910353] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-29" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.910353] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-29" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.910353] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-29" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.910725] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.911216] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.911297] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.913086] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.913086] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.913086] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.913086] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1018.913086] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1018.913086] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1018.913086] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.913086] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1018.913086] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1018.933806] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1018.933924] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1018.934132] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1018.934349] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-29" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.934735] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-161a5eee-a33f-419a-930c-866065512acb taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.934912] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-161a5eee-a33f-419a-930c-866065512acb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.935047] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-161a5eee-a33f-419a-930c-866065512acb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.935407] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-161a5eee-a33f-419a-930c-866065512acb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.935545] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('161a5eee-a33f-419a-930c-866065512acb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.957350] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0357b508-27d6-4922-abcc-e652c38b86f1 with status ACTIVE [ 1018.957590] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.957733] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.957793] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.958037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.958137] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.958325] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.958425] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.958482] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.958636] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.958713] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.958897] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.958992] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.959054] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.959199] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.959272] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.959360] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0357b508-27d6-4922-abcc-e652c38b86f1 is going to be updated. [ 1018.962906] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.963097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.963166] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.963345] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.963432] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.963632] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.963719] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.963784] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.963942] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.964021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.964108] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 already deleted. [ 1018.964181] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.990974] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.991203] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.991203] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.991404] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.991546] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.991715] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0357b508-27d6-4922-abcc-e652c38b86f1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.256821] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.257091] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.257091] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.261025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.261025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.261025] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58550c6c-a09f-469c-981b-0404b38bdf5d is going to be created. [ 1019.288929] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.289125] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.289219] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.289466] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.289637] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.303189] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58550c6c-a09f-469c-981b-0404b38bdf5d in Status: UNINITIALIZED for 2s [ 1019.377691] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-234 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.378037] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-234" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.378159] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-234" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.378401] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-234" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.378676] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.378843] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.378964] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.379492] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.379778] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.379940] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1019.380012] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1019.380130] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1019.380251] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1019.380381] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1019.380501] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1019.380639] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1019.403404] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1019.403404] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1019.403861] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1019.404066] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-234" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.404577] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-ff5fafc4-9731-4dab-945d-4209acfcb80b taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.404923] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-ff5fafc4-9731-4dab-945d-4209acfcb80b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.405091] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-ff5fafc4-9731-4dab-945d-4209acfcb80b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.405527] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-ff5fafc4-9731-4dab-945d-4209acfcb80b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.405778] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff5fafc4-9731-4dab-945d-4209acfcb80b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.438517] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.438774] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.438917] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.440883] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.440883] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.440883] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 161a5eee-a33f-419a-930c-866065512acb not found, creating... [ 1019.440883] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.440883] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.440883] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.440883] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.440883] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.441439] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.441439] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.441526] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.441776] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.441918] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.442079] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 161a5eee-a33f-419a-930c-866065512acb is going to be created. [ 1019.468953] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.469129] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.469172] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.469843] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.469843] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.470055] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-161a5eee-a33f-419a-930c-866065512acb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.635283] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: SUCCESS [ 1019.635743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.636389] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.636389] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.636656] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.636813] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.636995] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.637238] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.637424] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.637597] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.637802] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.639208] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.639572] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.640317] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.640317] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.640317] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.640317] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.640532] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.640684] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.909357] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.909512] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.909512] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.909807] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.909962] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.910138] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port ff5fafc4-9731-4dab-945d-4209acfcb80b not found, creating... [ 1019.910417] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.910584] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.910705] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.910953] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.911114] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.911504] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.911609] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.911679] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.911890] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.912039] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.912187] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: ff5fafc4-9731-4dab-945d-4209acfcb80b is going to be created. [ 1019.938505] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.938679] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.938835] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.939106] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.939416] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.939594] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-ff5fafc4-9731-4dab-945d-4209acfcb80b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.143120] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.143329] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.144425] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.260292] env[70520]: INFO networking_nsxv3.common.synchronization [req-2c585c3a-859f-423f-ab6c-c83367f31b92 req-c954bbcd-17ff-4bf4-877f-5f9441d89555 service nova] Enqueued Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_rules [ 1020.260292] env[70520]: INFO networking_nsxv3.common.synchronization [req-2c585c3a-859f-423f-ab6c-c83367f31b92 req-c954bbcd-17ff-4bf4-877f-5f9441d89555 service nova] Enqueued Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1020.260292] env[70520]: INFO networking_nsxv3.common.synchronization [req-2c585c3a-859f-423f-ab6c-c83367f31b92 req-c954bbcd-17ff-4bf4-877f-5f9441d89555 service nova] Enqueued Resource ID: 161a5eee-a33f-419a-930c-866065512acb with Priority: HIGHEST for action port [ 1020.264629] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_rules [ 1020.264629] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1020.264629] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161a5eee-a33f-419a-930c-866065512acb with Priority: HIGHEST for action port [ 1020.264629] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.264629] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.264629] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.264629] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.264629] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.264629] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.264629] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.264629] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.264629] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.265274] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.265399] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.265465] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.265699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.265814] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.265943] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.266971] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-161a5eee-a33f-419a-930c-866065512acb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.267138] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-161a5eee-a33f-419a-930c-866065512acb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.267233] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-161a5eee-a33f-419a-930c-866065512acb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.267467] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-161a5eee-a33f-419a-930c-866065512acb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.267562] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('161a5eee-a33f-419a-930c-866065512acb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.646414] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.776038] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.776038] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.776038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.776038] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 161a5eee-a33f-419a-930c-866065512acb with status ACTIVE [ 1020.776038] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.776038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.776038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.776038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.776038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.776038] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.776038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.776038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.776038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.776038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.776763] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.776763] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.776763] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.776763] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.776763] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.776763] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 161a5eee-a33f-419a-930c-866065512acb is going to be updated. [ 1020.805448] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.806104] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.806343] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.807430] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.807430] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.807430] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-161a5eee-a33f-419a-930c-866065512acb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.870078] env[70520]: INFO networking_nsxv3.common.synchronization [req-363beafc-24f8-47f6-9290-3b68326dfc9c req-7ba654c2-66c8-40c8-ad41-fd0c5ebb8ca3 service nova] Enqueued Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_rules [ 1020.870078] env[70520]: INFO networking_nsxv3.common.synchronization [req-363beafc-24f8-47f6-9290-3b68326dfc9c req-7ba654c2-66c8-40c8-ad41-fd0c5ebb8ca3 service nova] Enqueued Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1020.870078] env[70520]: INFO networking_nsxv3.common.synchronization [req-363beafc-24f8-47f6-9290-3b68326dfc9c req-7ba654c2-66c8-40c8-ad41-fd0c5ebb8ca3 service nova] Enqueued Resource ID: ff5fafc4-9731-4dab-945d-4209acfcb80b with Priority: HIGHEST for action port [ 1020.870078] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_rules [ 1020.870078] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1020.870078] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff5fafc4-9731-4dab-945d-4209acfcb80b with Priority: HIGHEST for action port [ 1020.870078] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.870078] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.874396] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.874396] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.874396] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff5fafc4-9731-4dab-945d-4209acfcb80b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.874396] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff5fafc4-9731-4dab-945d-4209acfcb80b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.874396] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff5fafc4-9731-4dab-945d-4209acfcb80b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.874396] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff5fafc4-9731-4dab-945d-4209acfcb80b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.874396] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff5fafc4-9731-4dab-945d-4209acfcb80b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.149414] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.150262] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.150379] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.150564] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.150640] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.150740] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a238fd65-d476-4f25-8c29-5e2babcc5026 is going to be updated. [ 1021.186284] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.186475] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.186475] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.186706] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.186790] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.197593] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: IN_PROGRESS for 2s [ 1021.282959] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.313388] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58550c6c-a09f-469c-981b-0404b38bdf5d in Status: SUCCESS [ 1021.313628] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.313760] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.313963] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.314167] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.314291] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.314352] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.314541] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.314627] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.314712] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.314813] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58550c6c-a09f-469c-981b-0404b38bdf5d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.377860] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff5fafc4-9731-4dab-945d-4209acfcb80b with status ACTIVE [ 1021.378098] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.378240] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.379054] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.379054] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.379054] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.379054] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.379054] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.379054] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.379299] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.379299] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.379367] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.379645] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.379645] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.379645] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.379814] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.379814] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff5fafc4-9731-4dab-945d-4209acfcb80b is going to be updated. [ 1021.400307] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.400536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.400536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.400719] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.400859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.401031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff5fafc4-9731-4dab-945d-4209acfcb80b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.788198] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.788401] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.788454] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.788684] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.788775] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.788879] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 is going to be created. [ 1021.814110] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.814279] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.814353] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.814565] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.814725] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.817394] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-58550c6c-a09f-469c-981b-0404b38bdf5d taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.817529] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.817589] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.817749] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.817942] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.818016] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.818239] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.818428] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.818523] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.818618] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.818772] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-58550c6c-a09f-469c-981b-0404b38bdf5d taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.818866] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.818922] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.819086] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.819235] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.819324] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.819391] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.819525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.819610] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.819678] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.819885] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58550c6c-a09f-469c-981b-0404b38bdf5d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.824709] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: UNINITIALIZED for 2s [ 1021.931024] env[70520]: INFO networking_nsxv3.common.synchronization [req-c9296f67-a229-4389-8bdb-4b666fe86e46 req-959f937c-b79f-4059-959e-252eee1efbe1 tempest-ServerActionsTestOtherA-325270290 tempest-ServerActionsTestOtherA-325270290-project-member] Enqueued Resource ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa with Priority: HIGHEST for action security_group_members [ 1021.931176] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa with Priority: HIGHEST for action security_group_members [ 1021.931723] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.931723] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.931723] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.931881] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.932095] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.932183] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.932183] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.932393] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.932456] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.932501] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9526fc0a-60e6-4c7c-a0b5-b827fe4038aa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.321583] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58550c6c-a09f-469c-981b-0404b38bdf5d: rpc.has_security_group_logging(os_id): False [ 1022.341919] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.342152] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.342255] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.342517] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.342634] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.342863] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.342977] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.343086] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.343324] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.343453] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.343684] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.343794] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.343892] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.344064] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.344147] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.344342] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.344435] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.344497] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.344684] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.344815] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.344912] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58550c6c-a09f-469c-981b-0404b38bdf5d is going to be created. [ 1022.423592] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.423783] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.423844] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.424067] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.424327] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.434735] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.434914] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.435033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.435335] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.435479] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.435769] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.435961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.436035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.436279] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.437553] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.437553] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa is going to be updated. [ 1022.442337] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58550c6c-a09f-469c-981b-0404b38bdf5d in Status: IN_PROGRESS for 2s [ 1022.485874] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.486110] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.486231] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.486512] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.486685] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.500704] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa in Status: IN_PROGRESS for 2s [ 1022.509022] env[70520]: INFO networking_nsxv3.common.synchronization [req-5d1be269-e210-4245-87c2-a174caad8baa req-0567f2ec-7570-4337-9281-7eca59dadfbf tempest-ServerActionsTestOtherB-256435736 tempest-ServerActionsTestOtherB-256435736-project-member] Enqueued Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_members [ 1022.509022] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_members [ 1022.509162] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d7f9020-5060-4aaf-81f1-cec3849eacc0 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.509281] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.509368] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.509572] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.509726] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.509821] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.509880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.510036] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.510115] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.510203] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.018955] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.018955] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.018955] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.018955] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.018955] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.018955] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.018955] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.018955] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.018955] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.018955] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.018955] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 is going to be updated. [ 1023.050743] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.050743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.050743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.050743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.050743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.060202] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: IN_PROGRESS for 2s [ 1023.131365] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-453 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.131365] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-453" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.131365] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-453" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.131365] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-453" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.131365] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.131365] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.132321] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.132886] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.133313] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.133810] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1023.134186] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1023.134412] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1023.134620] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1023.134973] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1023.135382] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1023.135773] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1023.158941] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1023.161221] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1023.161221] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1023.161221] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-453" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.161221] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-e13eaf87-126b-412f-a3fb-97bf53244088 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.161972] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-e13eaf87-126b-412f-a3fb-97bf53244088" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.162515] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-e13eaf87-126b-412f-a3fb-97bf53244088" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.162899] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-e13eaf87-126b-412f-a3fb-97bf53244088" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.163575] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e13eaf87-126b-412f-a3fb-97bf53244088',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.210975] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: SUCCESS [ 1023.210975] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.211219] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.211418] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.211615] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.211737] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.211865] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.212037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.212119] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.212205] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.212374] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.212462] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.212519] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.212644] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.212784] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.212881] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.213089] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.213293] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.213380] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.213470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.213565] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.214506] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.214667] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.214810] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.214911] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.214995] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.215259] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.215343] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.215434] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.667079] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.667079] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.667079] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.667590] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.667590] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.667590] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port e13eaf87-126b-412f-a3fb-97bf53244088 not found, creating... [ 1023.667792] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.668223] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.668223] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.668436] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.668436] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.668712] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.668869] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.669030] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.669217] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.669394] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.669604] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: e13eaf87-126b-412f-a3fb-97bf53244088 is going to be created. [ 1023.693062] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.693351] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.693490] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.693820] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.694030] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.694360] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-e13eaf87-126b-412f-a3fb-97bf53244088" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.718166] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a238fd65-d476-4f25-8c29-5e2babcc5026: rpc.has_security_group_logging(os_id): False [ 1023.719680] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.741112] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.741352] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.741352] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.741514] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.741600] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.741796] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.741892] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.741966] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.742118] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.742192] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.742421] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.742580] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.742580] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.742694] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.742743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.742928] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.743029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.743092] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.743229] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.743302] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.743385] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a238fd65-d476-4f25-8c29-5e2babcc5026 is going to be created. [ 1023.838687] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.838879] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.838954] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.839193] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.839586] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.841402] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: SUCCESS [ 1023.841680] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.842381] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.842676] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.842941] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.843179] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.843254] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.843477] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.843605] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.843739] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.843876] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.853682] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: IN_PROGRESS for 2s [ 1024.227398] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.349028] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.349028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.349028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.349028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.349028] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.349028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.349028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.349028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.349028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.349028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.349028] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.349028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.349028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.349028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.349028] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.349028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.349862] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.349862] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.349862] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.349862] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.349862] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.455812] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58550c6c-a09f-469c-981b-0404b38bdf5d in Status: SUCCESS [ 1024.455812] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.506332] env[70520]: INFO networking_nsxv3.common.synchronization [req-5d1be269-e210-4245-87c2-a174caad8baa req-5646a30a-15a3-4aa9-978e-794a3e30da36 service nova] Enqueued Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_rules [ 1024.506332] env[70520]: INFO networking_nsxv3.common.synchronization [req-5d1be269-e210-4245-87c2-a174caad8baa req-5646a30a-15a3-4aa9-978e-794a3e30da36 service nova] Enqueued Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_members [ 1024.506332] env[70520]: INFO networking_nsxv3.common.synchronization [req-5d1be269-e210-4245-87c2-a174caad8baa req-5646a30a-15a3-4aa9-978e-794a3e30da36 service nova] Enqueued Resource ID: e13eaf87-126b-412f-a3fb-97bf53244088 with Priority: HIGHEST for action port [ 1024.506332] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_rules [ 1024.506332] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_members [ 1024.506332] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e13eaf87-126b-412f-a3fb-97bf53244088 with Priority: HIGHEST for action port [ 1024.507490] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.507864] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.508082] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.508744] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.511091] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.511091] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d7f9020-5060-4aaf-81f1-cec3849eacc0 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.511091] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.511091] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-e13eaf87-126b-412f-a3fb-97bf53244088 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.511091] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e13eaf87-126b-412f-a3fb-97bf53244088" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.511091] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e13eaf87-126b-412f-a3fb-97bf53244088" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.511091] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e13eaf87-126b-412f-a3fb-97bf53244088" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.511091] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e13eaf87-126b-412f-a3fb-97bf53244088',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.515292] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa in Status: SUCCESS [ 1024.515292] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa deletion is rescheduled due to dependency. [ 1024.515446] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.728650] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.728924] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.728924] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.729204] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.729289] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.729352] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a238fd65-d476-4f25-8c29-5e2babcc5026 is going to be updated. [ 1024.761950] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.762398] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.762398] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.762520] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.762652] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.772999] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: IN_PROGRESS for 2s [ 1024.855073] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 468bd631-24dc-43d9-8a0f-93dcf753e208: rpc.has_security_group_logging(os_id): False [ 1024.875798] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.875798] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.876120] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.876120] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.876219] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.876373] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.876464] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.876525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.876673] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.876747] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.877989] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.877989] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.877989] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.877989] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.877989] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.877989] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.877989] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.877989] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.877989] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.877989] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.877989] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 is going to be created. [ 1024.974585] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.974803] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.974803] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.975028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.975233] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.995205] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: IN_PROGRESS for 2s [ 1025.013239] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d7f9020-5060-4aaf-81f1-cec3849eacc0 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.013373] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.013565] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e13eaf87-126b-412f-a3fb-97bf53244088 with status ACTIVE [ 1025.013774] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.013942] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.014092] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.014304] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.014393] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.014744] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.014744] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.014744] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.014959] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.014959] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.015186] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.015295] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.015339] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.015479] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.015548] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.015811] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e13eaf87-126b-412f-a3fb-97bf53244088 is going to be updated. [ 1025.038263] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.038428] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.038746] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.038746] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.039085] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.039085] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e13eaf87-126b-412f-a3fb-97bf53244088" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.076946] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: SUCCESS [ 1025.077275] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 deletion is rescheduled due to dependency. [ 1025.078590] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.078590] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.078590] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.078590] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.078868] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.078868] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.078939] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.079026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.079125] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.112161] env[70520]: INFO networking_nsxv3.common.synchronization [req-887a5895-c248-41e4-af9e-b919da622348 req-5ea2b629-a88a-4055-9cf0-07341d04cb71 tempest-ServersTestBootFromVolume-1414622987 tempest-ServersTestBootFromVolume-1414622987-project-member] Enqueued Resource ID: e1706c97-ada0-42a9-ae16-d557fcd51adb with Priority: HIGHEST for action security_group_members [ 1025.112870] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1706c97-ada0-42a9-ae16-d557fcd51adb with Priority: HIGHEST for action security_group_members [ 1025.113329] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1706c97-ada0-42a9-ae16-d557fcd51adb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.113539] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.113614] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.113863] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.114022] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.114129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.114204] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.114443] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.114554] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.114696] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1706c97-ada0-42a9-ae16-d557fcd51adb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.582443] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.621550] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.621550] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.621550] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.621550] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.621550] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.621550] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.621550] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.621550] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.621550] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.621550] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.621550] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1706c97-ada0-42a9-ae16-d557fcd51adb is going to be updated. [ 1025.656451] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.656451] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.656925] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.657478] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.657833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.670468] env[70520]: INFO networking_nsxv3.common.synchronization [req-3195fbbc-7606-46c3-b8dd-b4d154d18c24 req-de980f91-8bd2-4b5a-bf2f-4d0ddda554dc tempest-AttachVolumeNegativeTest-1224878754 tempest-AttachVolumeNegativeTest-1224878754-project-member] Enqueued Resource ID: da040ed9-9da1-43c9-b672-1e4e957ffa6c with Priority: HIGHEST for action security_group_members [ 1025.676267] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da040ed9-9da1-43c9-b672-1e4e957ffa6c with Priority: HIGHEST for action security_group_members [ 1025.676267] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1706c97-ada0-42a9-ae16-d557fcd51adb in Status: IN_PROGRESS for 2s [ 1025.676267] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-da040ed9-9da1-43c9-b672-1e4e957ffa6c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.676267] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da040ed9-9da1-43c9-b672-1e4e957ffa6c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.677036] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da040ed9-9da1-43c9-b672-1e4e957ffa6c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.677542] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da040ed9-9da1-43c9-b672-1e4e957ffa6c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.677542] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.679061] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.679061] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.679061] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.679061] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.679061] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da040ed9-9da1-43c9-b672-1e4e957ffa6c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.868905] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: SUCCESS [ 1025.871584] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.871584] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.871584] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.871584] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.089170] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.182888] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.183181] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.183260] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.183484] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.183569] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.187021] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.187021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.187021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.187021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.187021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.187021] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da040ed9-9da1-43c9-b672-1e4e957ffa6c already deleted. [ 1026.187021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da040ed9-9da1-43c9-b672-1e4e957ffa6c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.242525] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-811 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.242720] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-811" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.242835] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-811" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.243216] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-811" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.243389] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.243567] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.243670] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.243891] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.244289] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.244289] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1026.244430] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1026.244538] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1026.244606] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1026.244718] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1026.244826] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1026.244960] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1026.267047] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1026.267047] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1026.267047] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1026.267047] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-811" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.267047] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-ad38beef-d3e2-4609-b5a4-99c461391b4e taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.267047] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-ad38beef-d3e2-4609-b5a4-99c461391b4e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.267047] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-ad38beef-d3e2-4609-b5a4-99c461391b4e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.267047] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-ad38beef-d3e2-4609-b5a4-99c461391b4e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.267939] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad38beef-d3e2-4609-b5a4-99c461391b4e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.376160] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.376160] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.591558] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.591813] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.591937] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.592228] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.592331] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.592439] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 is going to be updated. [ 1026.637130] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.637130] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.637130] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.637418] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.637418] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.650959] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: IN_PROGRESS for 2s [ 1026.771922] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.772175] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.772323] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.772610] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.772750] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.772901] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port ad38beef-d3e2-4609-b5a4-99c461391b4e not found, creating... [ 1026.773182] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.773344] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.773465] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.773697] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.773837] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.774130] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.774291] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.774409] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.774615] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.774750] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.774888] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: ad38beef-d3e2-4609-b5a4-99c461391b4e is going to be created. [ 1026.786151] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: SUCCESS [ 1026.786530] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.786752] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.787012] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.787331] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.787475] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.787700] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.787757] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.787842] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.787952] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.788072] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.798546] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.798827] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.799044] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.799534] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.799766] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.799967] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-ad38beef-d3e2-4609-b5a4-99c461391b4e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.008592] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: SUCCESS [ 1027.008932] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.291070] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.293031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.293031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.293031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.293031] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.293031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.293031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.293031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.293031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.293031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.293482] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.293482] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.293482] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.293482] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.293675] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.293760] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.293808] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.293980] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.300021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.300021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.300021] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.684126] env[70520]: INFO networking_nsxv3.common.synchronization [req-3195fbbc-7606-46c3-b8dd-b4d154d18c24 req-57be1fef-2033-47ce-b342-270f8e00b4da service nova] Enqueued Resource ID: da040ed9-9da1-43c9-b672-1e4e957ffa6c with Priority: HIGHEST for action security_group_rules [ 1027.684315] env[70520]: INFO networking_nsxv3.common.synchronization [req-3195fbbc-7606-46c3-b8dd-b4d154d18c24 req-57be1fef-2033-47ce-b342-270f8e00b4da service nova] Enqueued Resource ID: da040ed9-9da1-43c9-b672-1e4e957ffa6c with Priority: HIGHEST for action security_group_members [ 1027.684465] env[70520]: INFO networking_nsxv3.common.synchronization [req-3195fbbc-7606-46c3-b8dd-b4d154d18c24 req-57be1fef-2033-47ce-b342-270f8e00b4da service nova] Enqueued Resource ID: ad38beef-d3e2-4609-b5a4-99c461391b4e with Priority: HIGHEST for action port [ 1027.685509] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1706c97-ada0-42a9-ae16-d557fcd51adb in Status: SUCCESS [ 1027.685802] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1706c97-ada0-42a9-ae16-d557fcd51adb deletion is rescheduled due to dependency. [ 1027.685802] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.686946] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da040ed9-9da1-43c9-b672-1e4e957ffa6c with Priority: HIGHEST for action security_group_rules [ 1027.687206] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da040ed9-9da1-43c9-b672-1e4e957ffa6c with Priority: HIGHEST for action security_group_members [ 1027.687313] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad38beef-d3e2-4609-b5a4-99c461391b4e with Priority: HIGHEST for action port [ 1027.687604] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da040ed9-9da1-43c9-b672-1e4e957ffa6c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.687727] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da040ed9-9da1-43c9-b672-1e4e957ffa6c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.687800] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da040ed9-9da1-43c9-b672-1e4e957ffa6c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.687981] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da040ed9-9da1-43c9-b672-1e4e957ffa6c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.688092] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da040ed9-9da1-43c9-b672-1e4e957ffa6c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.689390] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-da040ed9-9da1-43c9-b672-1e4e957ffa6c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.689390] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da040ed9-9da1-43c9-b672-1e4e957ffa6c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.689390] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da040ed9-9da1-43c9-b672-1e4e957ffa6c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.689631] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da040ed9-9da1-43c9-b672-1e4e957ffa6c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.689631] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.689631] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.689742] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.690865] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.690865] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.690865] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da040ed9-9da1-43c9-b672-1e4e957ffa6c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.691451] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad38beef-d3e2-4609-b5a4-99c461391b4e taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.691554] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad38beef-d3e2-4609-b5a4-99c461391b4e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.691618] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad38beef-d3e2-4609-b5a4-99c461391b4e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.691776] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad38beef-d3e2-4609-b5a4-99c461391b4e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.691870] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad38beef-d3e2-4609-b5a4-99c461391b4e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.803060] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a238fd65-d476-4f25-8c29-5e2babcc5026: rpc.has_security_group_logging(os_id): False [ 1027.827110] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.827332] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.827332] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.827589] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.827679] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.827833] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.827933] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.827990] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.828205] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.828293] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.828453] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.828555] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.828617] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.828744] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.828813] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.829009] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.829131] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.829184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.829308] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.829374] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.829504] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a238fd65-d476-4f25-8c29-5e2babcc5026 is going to be updated. [ 1027.914385] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.914629] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.914740] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.915031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.915191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.931281] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: IN_PROGRESS for 2s [ 1028.194354] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-da040ed9-9da1-43c9-b672-1e4e957ffa6c taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.194756] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da040ed9-9da1-43c9-b672-1e4e957ffa6c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.194756] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da040ed9-9da1-43c9-b672-1e4e957ffa6c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.195798] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ad38beef-d3e2-4609-b5a4-99c461391b4e with status ACTIVE [ 1028.195996] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.196151] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.196220] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.196426] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.199501] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.199501] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.199501] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.199501] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.199501] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.199501] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.199501] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.199501] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.199501] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.199501] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.199501] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.199501] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ad38beef-d3e2-4609-b5a4-99c461391b4e is going to be updated. [ 1028.223300] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.223485] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.223604] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.223918] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.224153] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.224396] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad38beef-d3e2-4609-b5a4-99c461391b4e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.661225] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: SUCCESS [ 1028.661457] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.661625] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.661845] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.662046] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.662165] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.662230] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.662380] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.662462] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.662543] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.662628] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.700776] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da040ed9-9da1-43c9-b672-1e4e957ffa6c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.165454] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.204187] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.204469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.204469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.204541] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.204616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.204714] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da040ed9-9da1-43c9-b672-1e4e957ffa6c is going to be created. [ 1029.231916] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.232065] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.232065] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.232250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.232410] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.245141] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da040ed9-9da1-43c9-b672-1e4e957ffa6c in Status: UNINITIALIZED for 2s [ 1029.668548] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d7f9020-5060-4aaf-81f1-cec3849eacc0: rpc.has_security_group_logging(os_id): False [ 1029.692077] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.692391] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.692391] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.692589] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.692589] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.692840] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.692936] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.693182] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.693182] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.693298] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.693370] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 is going to be updated. [ 1029.767818] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.768120] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.768120] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.768454] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.768508] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.789220] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: IN_PROGRESS for 2s [ 1029.948717] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: SUCCESS [ 1029.948974] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.949187] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.949491] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.949598] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.176053] env[70520]: INFO networking_nsxv3.common.synchronization [req-258f80bb-6949-4935-b049-b6781025797d req-15f3e89b-d419-4b04-a194-8a38c3ffc734 tempest-ServersAdminTestJSON-2063681355 tempest-ServersAdminTestJSON-2063681355-project-member] Enqueued Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_members [ 1030.176690] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_members [ 1030.177016] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.177470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.177470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.177577] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.177653] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.177800] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.177841] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.177957] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.178069] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.178223] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.453901] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.454296] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.454296] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.454383] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.454518] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.454633] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.454698] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.454851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.454935] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.455045] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.455162] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.680840] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.964163] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.964163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.964163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.964163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.964163] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.964163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.964163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.964163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.964163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.964163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.964163] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.964163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.964163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.964163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.964163] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.964163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.964775] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.964775] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.964775] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.964775] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.964775] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.187760] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.260889] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da040ed9-9da1-43c9-b672-1e4e957ffa6c in Status: SUCCESS [ 1031.260889] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da040ed9-9da1-43c9-b672-1e4e957ffa6c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.260889] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da040ed9-9da1-43c9-b672-1e4e957ffa6c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.260889] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da040ed9-9da1-43c9-b672-1e4e957ffa6c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.260889] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.260889] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.260889] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.260889] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.260889] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.260889] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da040ed9-9da1-43c9-b672-1e4e957ffa6c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.260889] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da040ed9-9da1-43c9-b672-1e4e957ffa6c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.467950] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a238fd65-d476-4f25-8c29-5e2babcc5026: rpc.has_security_group_logging(os_id): False [ 1031.492922] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.493169] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.493169] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.493434] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.493539] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.493706] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.493859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.493929] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.494184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.494184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.494471] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.494471] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.494471] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.494644] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.494682] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.495861] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.495861] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.495861] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.496174] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.496174] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.496260] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a238fd65-d476-4f25-8c29-5e2babcc5026 is going to be updated. [ 1031.562561] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.562723] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.562774] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.562979] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.563166] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.580294] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: IN_PROGRESS for 2s [ 1031.695030] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.695030] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.695030] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.695030] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.695030] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.695030] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 is going to be updated. [ 1031.734036] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.734036] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.734036] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.734036] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.734036] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.744377] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: IN_PROGRESS for 2s [ 1031.765497] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da040ed9-9da1-43c9-b672-1e4e957ffa6c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.804652] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: SUCCESS [ 1031.805187] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.268803] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da040ed9-9da1-43c9-b672-1e4e957ffa6c: rpc.has_security_group_logging(os_id): False [ 1032.288798] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.289892] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.289892] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.289892] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.289892] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.289892] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.290200] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.290200] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.290959] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.290959] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.290959] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da040ed9-9da1-43c9-b672-1e4e957ffa6c is going to be created. [ 1032.354063] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.354063] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.354063] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.354063] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.354063] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.369132] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da040ed9-9da1-43c9-b672-1e4e957ffa6c in Status: IN_PROGRESS for 2s [ 1033.605183] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: SUCCESS [ 1033.605602] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.757824] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: SUCCESS [ 1033.758113] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.387518] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da040ed9-9da1-43c9-b672-1e4e957ffa6c in Status: SUCCESS [ 1034.387518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da040ed9-9da1-43c9-b672-1e4e957ffa6c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.976507] env[70520]: INFO networking_nsxv3.common.synchronization [None req-bc4ece33-81dd-4dbf-9ca1-375b78f12527 None None] Enqueued Resource ID: 8576755f-2b17-4710-9879-9f861ca493d3 with Priority: HIGHEST for action port [ 1034.976826] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8576755f-2b17-4710-9879-9f861ca493d3 with Priority: HIGHEST for action port [ 1034.977409] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-8576755f-2b17-4710-9879-9f861ca493d3 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.977409] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8576755f-2b17-4710-9879-9f861ca493d3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.977409] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8576755f-2b17-4710-9879-9f861ca493d3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.977606] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8576755f-2b17-4710-9879-9f861ca493d3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.977606] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8576755f-2b17-4710-9879-9f861ca493d3',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.481288] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8576755f-2b17-4710-9879-9f861ca493d3 [ 1035.485155] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.485155] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.485155] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.485155] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.485155] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.485155] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8576755f-2b17-4710-9879-9f861ca493d3 already deleted. [ 1035.485155] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8576755f-2b17-4710-9879-9f861ca493d3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.178196] env[70520]: INFO networking_nsxv3.common.synchronization [req-4be282a4-6264-40ea-81ab-6419947190c4 req-10838084-2355-4fc3-9d48-ae8b5a1b646a tempest-ServersTestMultiNic-541139820 tempest-ServersTestMultiNic-541139820-project-member] Enqueued Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1036.178196] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1036.178196] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.178196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.178196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.179089] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.179397] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.179634] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.179785] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.180364] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.180606] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.180947] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.493054] env[70520]: INFO networking_nsxv3.common.synchronization [req-4be282a4-6264-40ea-81ab-6419947190c4 req-b4229352-4f9a-410f-a74b-d189ad851f43 tempest-ServersTestMultiNic-541139820 tempest-ServersTestMultiNic-541139820-project-member] Enqueued Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1036.493912] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1036.493989] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.495732] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.684763] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.816478] env[70520]: INFO networking_nsxv3.common.synchronization [req-4be282a4-6264-40ea-81ab-6419947190c4 req-0d66e691-c1fa-49c2-904f-9494f9b93dee tempest-ServersTestMultiNic-541139820 tempest-ServersTestMultiNic-541139820-project-member] Enqueued Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1036.816478] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1036.816691] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.816691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.974867] env[70520]: INFO networking_nsxv3.common.synchronization [None req-035159cd-926e-4630-9df7-0b350a6313da tempest-ServerActionsV293TestJSON-1078912952 tempest-ServerActionsV293TestJSON-1078912952-project-member] Enqueued Resource ID: 75f6513e-43fa-4780-ac9e-9333cfa1c6a9 with Priority: HIGHEST for action security_group_rules [ 1036.974867] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75f6513e-43fa-4780-ac9e-9333cfa1c6a9 with Priority: HIGHEST for action security_group_rules [ 1036.976442] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75f6513e-43fa-4780-ac9e-9333cfa1c6a9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.978261] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.978397] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.978682] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.978792] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75f6513e-43fa-4780-ac9e-9333cfa1c6a9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.171412] env[70520]: INFO networking_nsxv3.common.synchronization [None req-1f1446f5-4da5-4a37-b430-caccef708155 tempest-ServerActionsV293TestJSON-1078912952 tempest-ServerActionsV293TestJSON-1078912952-project-member] Enqueued Resource ID: 75f6513e-43fa-4780-ac9e-9333cfa1c6a9 with Priority: HIGHEST for action security_group_rules [ 1037.172316] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75f6513e-43fa-4780-ac9e-9333cfa1c6a9 with Priority: HIGHEST for action security_group_rules [ 1037.172435] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75f6513e-43fa-4780-ac9e-9333cfa1c6a9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.172906] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.187269] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.300659] env[70520]: INFO networking_nsxv3.common.synchronization [None req-389f4bf8-5f49-4b0c-9ddc-fbb53450d20b None None] Enqueued Resource ID: 4391d1cb-bac9-41c8-a8fb-a582b17dfa68 with Priority: HIGHEST for action port [ 1037.301406] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4391d1cb-bac9-41c8-a8fb-a582b17dfa68 with Priority: HIGHEST for action port [ 1037.301511] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-4391d1cb-bac9-41c8-a8fb-a582b17dfa68 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.301630] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4391d1cb-bac9-41c8-a8fb-a582b17dfa68" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.302076] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4391d1cb-bac9-41c8-a8fb-a582b17dfa68" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.302076] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4391d1cb-bac9-41c8-a8fb-a582b17dfa68" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.302171] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4391d1cb-bac9-41c8-a8fb-a582b17dfa68',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.582027] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.582027] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.582027] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.582027] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.582027] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.582027] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75f6513e-43fa-4780-ac9e-9333cfa1c6a9 already deleted. [ 1037.582027] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.582027] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.582457] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.582457] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75f6513e-43fa-4780-ac9e-9333cfa1c6a9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.690667] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.690667] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.690881] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.691025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.691076] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.691178] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a238fd65-d476-4f25-8c29-5e2babcc5026 is going to be updated. [ 1037.721580] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.721718] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.721786] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.722010] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.722156] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.735175] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: IN_PROGRESS for 2s [ 1037.805705] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4391d1cb-bac9-41c8-a8fb-a582b17dfa68 [ 1037.805972] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.806261] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.806310] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.806550] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.806645] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.807026] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4391d1cb-bac9-41c8-a8fb-a582b17dfa68 already deleted. [ 1037.807026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4391d1cb-bac9-41c8-a8fb-a582b17dfa68" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.071675] env[70520]: INFO networking_nsxv3.common.synchronization [req-dff54e3c-0c56-46fa-854b-97096ebfe965 req-cd7acf15-577b-45af-a70e-7fd479ce93ac tempest-ServersTestJSON-589199853 tempest-ServersTestJSON-589199853-project-member] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1038.072421] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1038.073308] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.073308] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.073308] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.073308] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.073308] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.073704] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.073704] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.073704] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.073862] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.074471] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.104929] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.105361] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.105480] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.105730] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.105825] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.105925] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75f6513e-43fa-4780-ac9e-9333cfa1c6a9 already deleted. [ 1038.106013] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.579802] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.580123] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.580123] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.580282] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.580370] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.580564] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.580661] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.580716] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.580863] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.580941] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.581040] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 already deleted. [ 1038.581143] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.173866] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-831 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.174558] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-831" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.174558] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-831" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.174649] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-831" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.174913] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.180054] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.180054] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.180054] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.180054] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.180054] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1039.180054] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1039.180054] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1039.180054] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1039.180054] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1039.180054] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1039.180054] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1039.204862] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1039.204862] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1039.205035] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1039.205091] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-831" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.207140] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-05c14fd5-4ea0-495e-9dc4-9c9caf692bb3 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.207140] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-05c14fd5-4ea0-495e-9dc4-9c9caf692bb3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.207140] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-05c14fd5-4ea0-495e-9dc4-9c9caf692bb3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.207140] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-05c14fd5-4ea0-495e-9dc4-9c9caf692bb3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.207140] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05c14fd5-4ea0-495e-9dc4-9c9caf692bb3',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.710245] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.713166] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.713166] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.713166] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.713166] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.713166] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 05c14fd5-4ea0-495e-9dc4-9c9caf692bb3 not found, creating... [ 1039.713166] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.713166] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.714107] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.714561] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.716732] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.716732] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.716732] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.716732] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.716732] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.716732] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.716732] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 05c14fd5-4ea0-495e-9dc4-9c9caf692bb3 is going to be created. [ 1039.742139] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.742604] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.743116] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.743282] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.743568] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.743994] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-05c14fd5-4ea0-495e-9dc4-9c9caf692bb3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.746375] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: SUCCESS [ 1039.746753] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.746859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.747082] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.747424] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.747521] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.747564] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.748661] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.748661] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.748766] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.220650] env[70520]: INFO networking_nsxv3.common.synchronization [None req-4f54469c-a1b1-4b53-95b0-f50e844beba5 None None] Enqueued Resource ID: dbefb2bd-e202-4db8-9e29-844a3a1a4198 with Priority: HIGHEST for action port [ 1040.220650] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbefb2bd-e202-4db8-9e29-844a3a1a4198 with Priority: HIGHEST for action port [ 1040.221014] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbefb2bd-e202-4db8-9e29-844a3a1a4198 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.221129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbefb2bd-e202-4db8-9e29-844a3a1a4198" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.221200] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbefb2bd-e202-4db8-9e29-844a3a1a4198" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.221453] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbefb2bd-e202-4db8-9e29-844a3a1a4198" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.221529] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbefb2bd-e202-4db8-9e29-844a3a1a4198',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.251417] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.251644] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.251729] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.252080] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.252259] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.254364] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.254581] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.254668] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.255015] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.255235] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.255424] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a238fd65-d476-4f25-8c29-5e2babcc5026 is going to be updated. [ 1040.294889] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.295185] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.295185] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.295320] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.295454] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.313836] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: IN_PROGRESS for 2s [ 1040.700211] env[70520]: INFO networking_nsxv3.common.synchronization [req-b7a19f94-f5a3-498a-9ac4-cac1bd9c0c2f req-7336a7a8-66cf-4ee9-b995-5cdf2c89e156 tempest-AttachVolumeTestJSON-1760709661 tempest-AttachVolumeTestJSON-1760709661-project-member] Enqueued Resource ID: ed51a6f5-8537-40e6-9b09-ff216cb9a61d with Priority: HIGHEST for action security_group_members [ 1040.700787] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed51a6f5-8537-40e6-9b09-ff216cb9a61d with Priority: HIGHEST for action security_group_members [ 1040.700787] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed51a6f5-8537-40e6-9b09-ff216cb9a61d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.700914] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed51a6f5-8537-40e6-9b09-ff216cb9a61d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.700914] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed51a6f5-8537-40e6-9b09-ff216cb9a61d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.702420] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed51a6f5-8537-40e6-9b09-ff216cb9a61d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.702420] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.702420] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.702420] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.702420] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.702420] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.702723] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed51a6f5-8537-40e6-9b09-ff216cb9a61d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.724177] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dbefb2bd-e202-4db8-9e29-844a3a1a4198 [ 1040.724454] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.724569] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.724649] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.724859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.724943] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.725055] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dbefb2bd-e202-4db8-9e29-844a3a1a4198 already deleted. [ 1040.725138] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbefb2bd-e202-4db8-9e29-844a3a1a4198" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.759307] env[70520]: INFO networking_nsxv3.common.synchronization [req-dff54e3c-0c56-46fa-854b-97096ebfe965 req-15b61342-c60b-4ffa-bffb-b5273924d84c service nova] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_rules [ 1040.759534] env[70520]: INFO networking_nsxv3.common.synchronization [req-dff54e3c-0c56-46fa-854b-97096ebfe965 req-15b61342-c60b-4ffa-bffb-b5273924d84c service nova] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1040.759674] env[70520]: INFO networking_nsxv3.common.synchronization [req-dff54e3c-0c56-46fa-854b-97096ebfe965 req-15b61342-c60b-4ffa-bffb-b5273924d84c service nova] Enqueued Resource ID: 05c14fd5-4ea0-495e-9dc4-9c9caf692bb3 with Priority: HIGHEST for action port [ 1040.760182] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_rules [ 1040.760334] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1040.760392] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05c14fd5-4ea0-495e-9dc4-9c9caf692bb3 with Priority: HIGHEST for action port [ 1040.763463] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.763463] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.763463] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.763463] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.763463] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.763463] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.763463] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.763463] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.763463] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.763463] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.763463] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.763463] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.763463] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.763463] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.763463] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.764694] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-05c14fd5-4ea0-495e-9dc4-9c9caf692bb3 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.764694] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05c14fd5-4ea0-495e-9dc4-9c9caf692bb3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.764694] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05c14fd5-4ea0-495e-9dc4-9c9caf692bb3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.764694] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05c14fd5-4ea0-495e-9dc4-9c9caf692bb3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.764694] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05c14fd5-4ea0-495e-9dc4-9c9caf692bb3',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.146892] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-356 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.146892] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-356" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.146892] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-356" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.146892] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-356" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.146892] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.147487] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.147999] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.148406] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.148762] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.149127] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1041.150413] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1041.150413] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1041.150413] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1041.150413] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1041.150413] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1041.150413] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1041.172558] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1041.174034] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1041.174034] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1041.174034] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-356" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.174034] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-ce1e80bb-9f7d-401e-9cbb-b9b06955e78e taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.174034] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-ce1e80bb-9f7d-401e-9cbb-b9b06955e78e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.174317] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-ce1e80bb-9f7d-401e-9cbb-b9b06955e78e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.174418] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-ce1e80bb-9f7d-401e-9cbb-b9b06955e78e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.174560] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce1e80bb-9f7d-401e-9cbb-b9b06955e78e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.208822] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.209258] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.209258] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.209426] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.209534] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.209779] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.209916] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.210052] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.210399] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.210490] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.210790] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed51a6f5-8537-40e6-9b09-ff216cb9a61d already deleted. [ 1041.210790] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed51a6f5-8537-40e6-9b09-ff216cb9a61d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.266378] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.266604] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.266830] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.267946] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05c14fd5-4ea0-495e-9dc4-9c9caf692bb3 with status ACTIVE [ 1041.267946] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.268209] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.268209] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.268350] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.268394] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.268555] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.268647] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.268697] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.268840] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.268909] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.272242] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.272401] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.272461] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.272649] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.272730] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.273050] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05c14fd5-4ea0-495e-9dc4-9c9caf692bb3 is going to be updated. [ 1041.304568] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.304956] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.305111] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.305393] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.305623] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.305876] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05c14fd5-4ea0-495e-9dc4-9c9caf692bb3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.678460] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.678817] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.678957] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.679247] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.679427] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.679636] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port ce1e80bb-9f7d-401e-9cbb-b9b06955e78e not found, creating... [ 1041.679924] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.680102] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.680229] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.680468] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.680609] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.680892] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.681066] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.681188] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.681409] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.681549] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.681759] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: ce1e80bb-9f7d-401e-9cbb-b9b06955e78e is going to be created. [ 1041.717799] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.718126] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.718337] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.718709] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.719133] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.719490] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-ce1e80bb-9f7d-401e-9cbb-b9b06955e78e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.776922] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.279410] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.280084] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.280238] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.280509] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.280621] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.280832] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be created. [ 1042.310048] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.310048] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.310048] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.310585] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.310837] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.327220] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: SUCCESS [ 1042.327442] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a238fd65-d476-4f25-8c29-5e2babcc5026 deletion is rescheduled due to dependency. [ 1042.327576] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.327776] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.328015] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.332016] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.332016] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.332016] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.332365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.332565] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.332744] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.334449] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: UNINITIALIZED for 2s [ 1042.532595] env[70520]: INFO networking_nsxv3.common.synchronization [req-b7a19f94-f5a3-498a-9ac4-cac1bd9c0c2f req-ee9ffd31-b52d-4b4d-ba33-f31d678c996c service nova] Enqueued Resource ID: ed51a6f5-8537-40e6-9b09-ff216cb9a61d with Priority: HIGHEST for action security_group_rules [ 1042.532740] env[70520]: INFO networking_nsxv3.common.synchronization [req-b7a19f94-f5a3-498a-9ac4-cac1bd9c0c2f req-ee9ffd31-b52d-4b4d-ba33-f31d678c996c service nova] Enqueued Resource ID: ed51a6f5-8537-40e6-9b09-ff216cb9a61d with Priority: HIGHEST for action security_group_members [ 1042.532913] env[70520]: INFO networking_nsxv3.common.synchronization [req-b7a19f94-f5a3-498a-9ac4-cac1bd9c0c2f req-ee9ffd31-b52d-4b4d-ba33-f31d678c996c service nova] Enqueued Resource ID: ce1e80bb-9f7d-401e-9cbb-b9b06955e78e with Priority: HIGHEST for action port [ 1042.533675] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed51a6f5-8537-40e6-9b09-ff216cb9a61d with Priority: HIGHEST for action security_group_rules [ 1042.533834] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed51a6f5-8537-40e6-9b09-ff216cb9a61d with Priority: HIGHEST for action security_group_members [ 1042.533956] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce1e80bb-9f7d-401e-9cbb-b9b06955e78e with Priority: HIGHEST for action port [ 1042.534393] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed51a6f5-8537-40e6-9b09-ff216cb9a61d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.534751] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed51a6f5-8537-40e6-9b09-ff216cb9a61d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.534751] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed51a6f5-8537-40e6-9b09-ff216cb9a61d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.535194] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed51a6f5-8537-40e6-9b09-ff216cb9a61d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.535194] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed51a6f5-8537-40e6-9b09-ff216cb9a61d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.539036] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed51a6f5-8537-40e6-9b09-ff216cb9a61d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.539036] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed51a6f5-8537-40e6-9b09-ff216cb9a61d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.539036] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed51a6f5-8537-40e6-9b09-ff216cb9a61d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.539036] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed51a6f5-8537-40e6-9b09-ff216cb9a61d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.539036] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.539036] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.539036] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.539036] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.539036] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.539036] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed51a6f5-8537-40e6-9b09-ff216cb9a61d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.539750] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce1e80bb-9f7d-401e-9cbb-b9b06955e78e taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.540285] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce1e80bb-9f7d-401e-9cbb-b9b06955e78e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.540920] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce1e80bb-9f7d-401e-9cbb-b9b06955e78e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.540920] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce1e80bb-9f7d-401e-9cbb-b9b06955e78e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.541173] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce1e80bb-9f7d-401e-9cbb-b9b06955e78e',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.743135] env[70520]: INFO networking_nsxv3.common.synchronization [None req-ca7ff63f-7f59-4b49-b2eb-fb42f3d15bd2 None None] Enqueued Resource ID: 001416fa-6beb-4645-b584-285500feafb2 with Priority: HIGHEST for action port [ 1042.744449] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 001416fa-6beb-4645-b584-285500feafb2 with Priority: HIGHEST for action port [ 1042.744449] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-001416fa-6beb-4645-b584-285500feafb2 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.744449] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-001416fa-6beb-4645-b584-285500feafb2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.744449] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-001416fa-6beb-4645-b584-285500feafb2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.746675] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-001416fa-6beb-4645-b584-285500feafb2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.746870] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('001416fa-6beb-4645-b584-285500feafb2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.842883] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.842883] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.842883] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.842883] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.842883] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.842883] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.842883] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.842883] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.842883] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.842883] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.842883] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a238fd65-d476-4f25-8c29-5e2babcc5026 is going to be updated. [ 1042.871988] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.871988] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.871988] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.871988] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.871988] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.880934] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: IN_PROGRESS for 2s [ 1043.046065] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed51a6f5-8537-40e6-9b09-ff216cb9a61d taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.046065] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed51a6f5-8537-40e6-9b09-ff216cb9a61d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.046065] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed51a6f5-8537-40e6-9b09-ff216cb9a61d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.046065] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce1e80bb-9f7d-401e-9cbb-b9b06955e78e with status ACTIVE [ 1043.046065] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.046065] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.046412] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.046412] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.046607] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.046676] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.048758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.048758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.048758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.048758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.048758] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.048758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.048758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.048758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.049439] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.049439] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce1e80bb-9f7d-401e-9cbb-b9b06955e78e is going to be updated. [ 1043.076353] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.076353] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.076353] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.076353] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.076540] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.076855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce1e80bb-9f7d-401e-9cbb-b9b06955e78e" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.249052] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 001416fa-6beb-4645-b584-285500feafb2 [ 1043.249300] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.249472] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.249568] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.249790] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.249874] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.250152] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:001416fa-6beb-4645-b584-285500feafb2 already deleted. [ 1043.250152] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-001416fa-6beb-4645-b584-285500feafb2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.551671] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed51a6f5-8537-40e6-9b09-ff216cb9a61d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.588591] env[70520]: INFO networking_nsxv3.common.synchronization [None req-e5ac8396-a01c-4edf-8ac9-b1d6c9c14914 tempest-AttachInterfacesTestJSON-1687744298 tempest-AttachInterfacesTestJSON-1687744298-project-member] Enqueued Resource ID: 9d478320-7685-43e1-8bec-cd33229a3a3f with Priority: HIGHEST for action security_group_rules [ 1043.589180] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d478320-7685-43e1-8bec-cd33229a3a3f with Priority: HIGHEST for action security_group_rules [ 1043.589523] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d478320-7685-43e1-8bec-cd33229a3a3f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.589683] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d478320-7685-43e1-8bec-cd33229a3a3f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.589790] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d478320-7685-43e1-8bec-cd33229a3a3f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.590922] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d478320-7685-43e1-8bec-cd33229a3a3f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.590994] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d478320-7685-43e1-8bec-cd33229a3a3f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.688583] env[70520]: INFO networking_nsxv3.common.synchronization [None req-eaf0e33e-3f6f-415f-917e-c4a82dd6698d tempest-AttachInterfacesTestJSON-1687744298 tempest-AttachInterfacesTestJSON-1687744298-project-member] Enqueued Resource ID: 9d478320-7685-43e1-8bec-cd33229a3a3f with Priority: HIGHEST for action security_group_rules [ 1043.689211] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d478320-7685-43e1-8bec-cd33229a3a3f with Priority: HIGHEST for action security_group_rules [ 1043.689542] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d478320-7685-43e1-8bec-cd33229a3a3f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.689646] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d478320-7685-43e1-8bec-cd33229a3a3f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.054535] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.054535] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.055026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.055026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.055139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.055307] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed51a6f5-8537-40e6-9b09-ff216cb9a61d is going to be created. [ 1044.085938] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.086133] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.086179] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.087146] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.087146] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.097333] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed51a6f5-8537-40e6-9b09-ff216cb9a61d in Status: UNINITIALIZED for 2s [ 1044.116791] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.116791] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.116791] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.116791] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.116791] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.117122] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d478320-7685-43e1-8bec-cd33229a3a3f already deleted. [ 1044.117122] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d478320-7685-43e1-8bec-cd33229a3a3f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.117122] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d478320-7685-43e1-8bec-cd33229a3a3f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.118031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d478320-7685-43e1-8bec-cd33229a3a3f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.118031] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d478320-7685-43e1-8bec-cd33229a3a3f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.345797] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: SUCCESS [ 1044.346086] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.346393] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.346634] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.346859] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.347017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.347091] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.347424] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.347522] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.347643] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.348222] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.551449] env[70520]: INFO networking_nsxv3.common.synchronization [req-9c5d008e-ed4c-4d8a-846c-cafdf7874b02 req-1dda1657-5ea4-4667-9d40-ce470615799e tempest-ServersNegativeTestJSON-641348566 tempest-ServersNegativeTestJSON-641348566-project-member] Enqueued Resource ID: d202bbfa-42d6-4633-985f-b1007599bbf2 with Priority: HIGHEST for action security_group_members [ 1044.551449] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d202bbfa-42d6-4633-985f-b1007599bbf2 with Priority: HIGHEST for action security_group_members [ 1044.551449] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d202bbfa-42d6-4633-985f-b1007599bbf2 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.551449] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.551634] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.551865] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.552026] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.552149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.552197] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.552347] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.552506] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.552561] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d202bbfa-42d6-4633-985f-b1007599bbf2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.643382] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.643382] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.643543] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.643657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.643892] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.643989] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d478320-7685-43e1-8bec-cd33229a3a3f already deleted. [ 1044.644070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d478320-7685-43e1-8bec-cd33229a3a3f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.851129] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.851129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.851129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.851443] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.852112] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.852112] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.852112] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.852112] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.852398] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.852398] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.852508] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.852508] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.852587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.853191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.853191] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.853191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.853191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.853459] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.853459] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.853459] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.853594] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.893264] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: SUCCESS [ 1044.893472] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a238fd65-d476-4f25-8c29-5e2babcc5026 deletion is rescheduled due to dependency. [ 1044.893610] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.056104] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.056445] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.056445] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.056545] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.056633] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.056827] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.056927] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.056988] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.057149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.057250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.057334] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d202bbfa-42d6-4633-985f-b1007599bbf2 is going to be updated. [ 1045.108022] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.108022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.108022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.108022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.108022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.120703] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d202bbfa-42d6-4633-985f-b1007599bbf2 in Status: IN_PROGRESS for 2s [ 1045.359275] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a927ecd-fa02-4905-9c80-5ef71a14a848: rpc.has_security_group_logging(os_id): False [ 1045.380787] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.380787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.380787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.380787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.380787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.380787] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.380787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.380787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.380787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.380787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.380787] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.380787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.380787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.380787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.380787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.381290] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.381290] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.381290] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.381290] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.381290] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.381290] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be created. [ 1045.447521] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.447762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.447762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.447953] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.448152] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.462215] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: IN_PROGRESS for 2s [ 1046.111021] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed51a6f5-8537-40e6-9b09-ff216cb9a61d in Status: SUCCESS [ 1046.111021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed51a6f5-8537-40e6-9b09-ff216cb9a61d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.111021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed51a6f5-8537-40e6-9b09-ff216cb9a61d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.111021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed51a6f5-8537-40e6-9b09-ff216cb9a61d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.111021] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.111021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.111021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.111021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.111021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.111021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed51a6f5-8537-40e6-9b09-ff216cb9a61d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.111021] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed51a6f5-8537-40e6-9b09-ff216cb9a61d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.617852] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed51a6f5-8537-40e6-9b09-ff216cb9a61d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.123431] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed51a6f5-8537-40e6-9b09-ff216cb9a61d: rpc.has_security_group_logging(os_id): False [ 1047.144327] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d202bbfa-42d6-4633-985f-b1007599bbf2 in Status: SUCCESS [ 1047.144327] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d202bbfa-42d6-4633-985f-b1007599bbf2 deletion is rescheduled due to dependency. [ 1047.144327] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d202bbfa-42d6-4633-985f-b1007599bbf2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.144327] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.144327] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.144327] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.144788] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.144788] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.144788] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.144906] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.144936] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.145149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.145149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.145383] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed51a6f5-8537-40e6-9b09-ff216cb9a61d is going to be created. [ 1047.214733] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.214733] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.214733] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.215393] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.215393] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.229536] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed51a6f5-8537-40e6-9b09-ff216cb9a61d in Status: IN_PROGRESS for 2s [ 1047.477813] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: SUCCESS [ 1047.477981] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.252677] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed51a6f5-8537-40e6-9b09-ff216cb9a61d in Status: SUCCESS [ 1049.252677] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed51a6f5-8537-40e6-9b09-ff216cb9a61d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.552396] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1049.552557] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1049.795523] env[70520]: INFO networking_nsxv3.common.synchronization [req-d60cb515-6d15-448a-b908-51fa0b2121a1 req-98951a3e-ee6c-4480-af7a-d978c227ff3e tempest-ImagesTestJSON-1211196503 tempest-ImagesTestJSON-1211196503-project-member] Enqueued Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1049.796620] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1049.796620] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.796864] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.796864] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.797293] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.798686] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.798686] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.798686] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.798686] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.799207] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.800930] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.934913] env[70520]: INFO networking_nsxv3.common.synchronization [req-f2942043-1400-44dc-ba5b-ea8971107ed5 req-e12eaab1-f1b7-4616-b42b-1b6dad08250f tempest-DeleteServersTestJSON-1399047283 tempest-DeleteServersTestJSON-1399047283-project-member] Enqueued Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 1049.936971] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 1049.938152] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.938657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.938848] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.939204] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.939460] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.939665] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.939758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.941528] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.941528] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.941528] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.303840] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.304366] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.304366] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.304366] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.304591] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.304680] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.304785] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.304841] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.304998] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.306196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.306196] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 is going to be updated. [ 1050.339890] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.340076] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.340139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.340315] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.340455] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.354822] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: IN_PROGRESS for 2s [ 1050.447426] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.447798] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.447798] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.448052] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.448052] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.448259] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.450641] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.450641] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.450641] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.450641] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.450641] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f is going to be updated. [ 1050.480298] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.480453] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.480524] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.480734] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.480874] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.491782] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: IN_PROGRESS for 2s [ 1050.519536] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-493 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.519789] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-493" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.521469] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-493" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.521469] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-493" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.521469] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.521469] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.521469] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.521469] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.521469] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.521469] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1050.522474] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1050.522474] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1050.522474] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1050.522474] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1050.522474] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1050.524173] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1050.546213] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1050.546213] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1050.546213] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1050.546213] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-493" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.546377] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-7467261c-0700-439f-afe7-3ed1f18e18e9 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.546507] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-7467261c-0700-439f-afe7-3ed1f18e18e9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.546645] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-7467261c-0700-439f-afe7-3ed1f18e18e9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.547025] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-7467261c-0700-439f-afe7-3ed1f18e18e9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.549090] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7467261c-0700-439f-afe7-3ed1f18e18e9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.129888] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.129888] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.129888] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.129888] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.129888] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.129888] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 7467261c-0700-439f-afe7-3ed1f18e18e9 not found, creating... [ 1051.129888] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.129888] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.129888] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.129888] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.129888] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.134049] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.134049] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.134049] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.134049] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.134049] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.134049] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 7467261c-0700-439f-afe7-3ed1f18e18e9 is going to be created. [ 1051.134049] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.134049] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.134049] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.136056] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.136056] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.136056] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-7467261c-0700-439f-afe7-3ed1f18e18e9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.136056] env[70520]: INFO networking_nsxv3.common.synchronization [None req-a19a726e-be0d-43e0-8a56-0bfd156271cf None None] Enqueued Resource ID: 11417b81-a9c5-4380-8623-0f75e6a488cd with Priority: HIGHEST for action port [ 1051.136056] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11417b81-a9c5-4380-8623-0f75e6a488cd with Priority: HIGHEST for action port [ 1051.136056] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-11417b81-a9c5-4380-8623-0f75e6a488cd taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.136056] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11417b81-a9c5-4380-8623-0f75e6a488cd" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.136056] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11417b81-a9c5-4380-8623-0f75e6a488cd" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.136056] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11417b81-a9c5-4380-8623-0f75e6a488cd" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.136056] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11417b81-a9c5-4380-8623-0f75e6a488cd',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.611861] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 11417b81-a9c5-4380-8623-0f75e6a488cd [ 1051.611861] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.611861] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.611861] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.612305] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.612305] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.612305] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:11417b81-a9c5-4380-8623-0f75e6a488cd already deleted. [ 1051.612401] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11417b81-a9c5-4380-8623-0f75e6a488cd" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.928400] env[70520]: INFO networking_nsxv3.common.synchronization [req-f2942043-1400-44dc-ba5b-ea8971107ed5 req-eae8f0be-07fb-448d-9185-78273566d1ab service nova] Enqueued Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_rules [ 1051.928400] env[70520]: INFO networking_nsxv3.common.synchronization [req-f2942043-1400-44dc-ba5b-ea8971107ed5 req-eae8f0be-07fb-448d-9185-78273566d1ab service nova] Enqueued Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 1051.928400] env[70520]: INFO networking_nsxv3.common.synchronization [req-f2942043-1400-44dc-ba5b-ea8971107ed5 req-eae8f0be-07fb-448d-9185-78273566d1ab service nova] Enqueued Resource ID: 7467261c-0700-439f-afe7-3ed1f18e18e9 with Priority: HIGHEST for action port [ 1051.930778] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_rules [ 1051.931014] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 1051.931170] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7467261c-0700-439f-afe7-3ed1f18e18e9 with Priority: HIGHEST for action port [ 1051.931562] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.931737] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.931830] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.933343] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.933429] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.935537] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.935655] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.935856] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-7467261c-0700-439f-afe7-3ed1f18e18e9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.935962] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7467261c-0700-439f-afe7-3ed1f18e18e9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.938281] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7467261c-0700-439f-afe7-3ed1f18e18e9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.938281] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7467261c-0700-439f-afe7-3ed1f18e18e9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.938281] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7467261c-0700-439f-afe7-3ed1f18e18e9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.368046] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: SUCCESS [ 1052.368046] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 deletion is rescheduled due to dependency. [ 1052.368046] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.439548] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.440030] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.440455] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7467261c-0700-439f-afe7-3ed1f18e18e9 with status ACTIVE [ 1052.440812] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.441085] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.441230] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.441529] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.441703] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.443375] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.443375] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.443375] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.443375] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.443375] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.443375] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.443375] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.443375] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.443375] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.443375] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.443375] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7467261c-0700-439f-afe7-3ed1f18e18e9 is going to be updated. [ 1052.469402] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.469546] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.469546] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.469784] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.469954] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.470146] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7467261c-0700-439f-afe7-3ed1f18e18e9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.503104] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: SUCCESS [ 1052.503303] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f deletion is rescheduled due to dependency. [ 1052.503421] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.503590] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.503817] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.503998] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.504165] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.504242] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.504385] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.504472] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.504569] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.008295] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.336762] env[70520]: INFO networking_nsxv3.common.synchronization [None req-8f665383-be74-4340-81fe-2475dc9dda05 None None] Enqueued Resource ID: 990d955c-aa55-440f-9f19-4c411c4746d4 with Priority: HIGHEST for action port [ 1053.337057] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 990d955c-aa55-440f-9f19-4c411c4746d4 with Priority: HIGHEST for action port [ 1053.337771] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-990d955c-aa55-440f-9f19-4c411c4746d4 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.337905] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-990d955c-aa55-440f-9f19-4c411c4746d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.337976] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-990d955c-aa55-440f-9f19-4c411c4746d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.338284] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-990d955c-aa55-440f-9f19-4c411c4746d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.338455] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('990d955c-aa55-440f-9f19-4c411c4746d4',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.514500] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.646682] env[70520]: INFO networking_nsxv3.common.synchronization [None req-1ec56149-26ff-4801-809a-8df42c19c4a4 tempest-ServerActionsTestOtherA-325270290 tempest-ServerActionsTestOtherA-325270290-project-member] Enqueued Resource ID: 049500dd-1e0c-481a-b7e8-f7bc25741086 with Priority: HIGHEST for action security_group_rules [ 1053.647230] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 049500dd-1e0c-481a-b7e8-f7bc25741086 with Priority: HIGHEST for action security_group_rules [ 1053.647586] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-049500dd-1e0c-481a-b7e8-f7bc25741086 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.647696] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-049500dd-1e0c-481a-b7e8-f7bc25741086" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.647822] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-049500dd-1e0c-481a-b7e8-f7bc25741086" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.648031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-049500dd-1e0c-481a-b7e8-f7bc25741086" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.648116] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('049500dd-1e0c-481a-b7e8-f7bc25741086',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.742615] env[70520]: INFO networking_nsxv3.common.synchronization [None req-50af14eb-8566-4204-ac95-56fb38e27128 tempest-ServerActionsTestOtherA-325270290 tempest-ServerActionsTestOtherA-325270290-project-member] Enqueued Resource ID: 049500dd-1e0c-481a-b7e8-f7bc25741086 with Priority: HIGHEST for action security_group_rules [ 1053.743773] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 049500dd-1e0c-481a-b7e8-f7bc25741086 with Priority: HIGHEST for action security_group_rules [ 1053.744224] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-049500dd-1e0c-481a-b7e8-f7bc25741086 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.744335] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-049500dd-1e0c-481a-b7e8-f7bc25741086" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.840873] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 990d955c-aa55-440f-9f19-4c411c4746d4 [ 1053.841129] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.841258] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.841322] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.841531] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.841620] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.841714] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:990d955c-aa55-440f-9f19-4c411c4746d4 already deleted. [ 1053.841793] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-990d955c-aa55-440f-9f19-4c411c4746d4" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.017044] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.017430] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.017430] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.017581] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.017636] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.017736] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f is going to be updated. [ 1054.050332] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.050332] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.050528] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.051041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.051041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.060019] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: IN_PROGRESS for 2s [ 1054.175694] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.175970] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.175970] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.176252] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.176387] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.176521] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 049500dd-1e0c-481a-b7e8-f7bc25741086 already deleted. [ 1054.176655] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-049500dd-1e0c-481a-b7e8-f7bc25741086" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.176893] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-049500dd-1e0c-481a-b7e8-f7bc25741086" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.177116] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-049500dd-1e0c-481a-b7e8-f7bc25741086" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.177470] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('049500dd-1e0c-481a-b7e8-f7bc25741086',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.699131] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.699284] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.699345] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.699630] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.699716] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.699835] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 049500dd-1e0c-481a-b7e8-f7bc25741086 already deleted. [ 1054.700040] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-049500dd-1e0c-481a-b7e8-f7bc25741086" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.367193] env[70520]: INFO networking_nsxv3.common.synchronization [None req-2f51eed4-4d4c-4acc-8b2c-ce334fac2144 tempest-ServerActionsTestJSON-420425725 tempest-ServerActionsTestJSON-420425725-project-member] Enqueued Resource ID: 4c90693a-14b7-438f-84ec-4b2ae33515d7 with Priority: HIGHEST for action security_group_rules [ 1055.367759] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c90693a-14b7-438f-84ec-4b2ae33515d7 with Priority: HIGHEST for action security_group_rules [ 1055.368423] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c90693a-14b7-438f-84ec-4b2ae33515d7 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.368524] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c90693a-14b7-438f-84ec-4b2ae33515d7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.368524] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c90693a-14b7-438f-84ec-4b2ae33515d7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.369089] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c90693a-14b7-438f-84ec-4b2ae33515d7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.369169] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c90693a-14b7-438f-84ec-4b2ae33515d7',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.466986] env[70520]: INFO networking_nsxv3.common.synchronization [None req-cdd1a7d4-479a-467a-9ad1-4a8e377986f3 tempest-ServerActionsTestJSON-420425725 tempest-ServerActionsTestJSON-420425725-project-member] Enqueued Resource ID: 4c90693a-14b7-438f-84ec-4b2ae33515d7 with Priority: HIGHEST for action security_group_rules [ 1055.467265] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c90693a-14b7-438f-84ec-4b2ae33515d7 with Priority: HIGHEST for action security_group_rules [ 1055.467782] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c90693a-14b7-438f-84ec-4b2ae33515d7 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.467887] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c90693a-14b7-438f-84ec-4b2ae33515d7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.894254] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.894254] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.894254] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.894254] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.894254] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.894254] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c90693a-14b7-438f-84ec-4b2ae33515d7 already deleted. [ 1055.894254] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c90693a-14b7-438f-84ec-4b2ae33515d7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.894254] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c90693a-14b7-438f-84ec-4b2ae33515d7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.894254] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c90693a-14b7-438f-84ec-4b2ae33515d7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.894254] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c90693a-14b7-438f-84ec-4b2ae33515d7',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.070080] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: SUCCESS [ 1056.070348] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.070531] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.070798] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.071028] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.071174] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.071256] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.071430] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.071534] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.071648] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.071793] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.423198] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.423198] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.423198] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.423198] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.423198] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.423198] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c90693a-14b7-438f-84ec-4b2ae33515d7 already deleted. [ 1056.423198] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c90693a-14b7-438f-84ec-4b2ae33515d7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.574347] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.574512] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.574585] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.574814] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.574984] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.575104] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.575188] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.575353] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.575437] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.575525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.575723] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.575834] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.575895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.576053] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.576196] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.576289] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.576441] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.576522] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.576600] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.576680] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.576760] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.082284] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 80751702-3cad-4ef3-af48-e8bd866c7e7f: rpc.has_security_group_logging(os_id): False [ 1057.101529] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.101699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.101769] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.101995] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.102174] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.102452] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.102563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.102631] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.102866] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.102958] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.103153] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.103251] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.103313] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.103450] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.103521] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.103693] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.103859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.103859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.104014] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.105139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.105659] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f is going to be updated. [ 1057.166854] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.167154] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.167209] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.167586] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.167807] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.186765] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: IN_PROGRESS for 2s [ 1059.206910] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: SUCCESS [ 1059.206910] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.297016] env[70520]: INFO networking_nsxv3.common.synchronization [req-28c304cf-2b8c-4de2-ac82-6a99c2406c65 req-cd197804-29aa-4ecf-9e49-e71563a25c33 tempest-ServersAdminTestJSON-2063681355 tempest-ServersAdminTestJSON-2063681355-project-member] Enqueued Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_members [ 1059.297576] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_members [ 1059.297891] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.298021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.299146] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.299365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.299537] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.299654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.299758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.299862] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.299943] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.300048] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.804148] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.309266] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.812661] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.812839] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.812909] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.813159] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.813254] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.813383] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 is going to be updated. [ 1060.848277] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.848442] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.848517] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.848736] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.848883] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.858756] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: IN_PROGRESS for 2s [ 1062.886879] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: SUCCESS [ 1062.887184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.199769] env[70520]: INFO networking_nsxv3.common.synchronization [req-bf06a7bf-8053-4636-8d7f-6820242da680 req-6b2023f8-22af-4545-ac4e-50dcd56093d6 tempest-ServerRescueTestJSON-1210437654 tempest-ServerRescueTestJSON-1210437654-project-member] Enqueued Resource ID: 58550c6c-a09f-469c-981b-0404b38bdf5d with Priority: HIGHEST for action security_group_members [ 1064.200719] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58550c6c-a09f-469c-981b-0404b38bdf5d with Priority: HIGHEST for action security_group_members [ 1064.201279] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-58550c6c-a09f-469c-981b-0404b38bdf5d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.201545] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.201699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.201996] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.204057] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.204057] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.204057] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.204057] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.204057] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.204057] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58550c6c-a09f-469c-981b-0404b38bdf5d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.705383] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58550c6c-a09f-469c-981b-0404b38bdf5d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.820110] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-335 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.820110] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-335" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.820110] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-335" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.820110] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-335" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.820110] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.820110] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.820110] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.820110] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.820110] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.820816] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1064.821119] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1064.823919] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1064.823919] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1064.823919] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1064.823919] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1064.823919] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1064.843172] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1064.843342] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1064.843494] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1064.843666] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-335" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.843984] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-4d14b486-8771-4c96-baad-0bd018b270aa taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.844172] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-4d14b486-8771-4c96-baad-0bd018b270aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.844290] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-4d14b486-8771-4c96-baad-0bd018b270aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.844653] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-4d14b486-8771-4c96-baad-0bd018b270aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.844746] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d14b486-8771-4c96-baad-0bd018b270aa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.207642] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58550c6c-a09f-469c-981b-0404b38bdf5d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.346857] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.347116] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.347264] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.347617] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.347745] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.347990] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 4d14b486-8771-4c96-baad-0bd018b270aa not found, creating... [ 1065.348313] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.348557] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.348810] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.349080] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.349338] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.349732] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.349913] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.350066] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.350349] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.351677] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.351677] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 4d14b486-8771-4c96-baad-0bd018b270aa is going to be created. [ 1065.392914] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.392914] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.392914] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.392914] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.392914] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.393307] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-4d14b486-8771-4c96-baad-0bd018b270aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.714473] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.714473] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.714473] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.714473] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.714473] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.714473] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58550c6c-a09f-469c-981b-0404b38bdf5d is going to be updated. [ 1065.743462] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.745375] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.745632] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.745959] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.746415] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.755888] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58550c6c-a09f-469c-981b-0404b38bdf5d in Status: IN_PROGRESS for 2s [ 1065.829133] env[70520]: INFO networking_nsxv3.common.synchronization [req-bfee6f44-9451-4bb2-b5eb-b426377a4935 req-ef43bd8c-c7e9-480c-8829-10f1991b7a8e tempest-DeleteServersTestJSON-1399047283 tempest-DeleteServersTestJSON-1399047283-project-member] Enqueued Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 1065.829652] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 1065.829955] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.830139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.830211] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.830453] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.830605] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.831654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.831654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.831654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.831654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.831654] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.101841] env[70520]: INFO networking_nsxv3.common.synchronization [req-bf06a7bf-8053-4636-8d7f-6820242da680 req-56cfa2be-798e-4e32-bc2b-815386af2f0b service nova] Enqueued Resource ID: 58550c6c-a09f-469c-981b-0404b38bdf5d with Priority: HIGHEST for action security_group_rules [ 1066.102046] env[70520]: INFO networking_nsxv3.common.synchronization [req-bf06a7bf-8053-4636-8d7f-6820242da680 req-56cfa2be-798e-4e32-bc2b-815386af2f0b service nova] Enqueued Resource ID: 58550c6c-a09f-469c-981b-0404b38bdf5d with Priority: HIGHEST for action security_group_members [ 1066.102179] env[70520]: INFO networking_nsxv3.common.synchronization [req-bf06a7bf-8053-4636-8d7f-6820242da680 req-56cfa2be-798e-4e32-bc2b-815386af2f0b service nova] Enqueued Resource ID: 4d14b486-8771-4c96-baad-0bd018b270aa with Priority: HIGHEST for action port [ 1066.102711] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58550c6c-a09f-469c-981b-0404b38bdf5d with Priority: HIGHEST for action security_group_rules [ 1066.102852] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58550c6c-a09f-469c-981b-0404b38bdf5d with Priority: HIGHEST for action security_group_members [ 1066.103285] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d14b486-8771-4c96-baad-0bd018b270aa with Priority: HIGHEST for action port [ 1066.103792] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58550c6c-a09f-469c-981b-0404b38bdf5d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.103927] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.103984] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.104183] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.104260] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58550c6c-a09f-469c-981b-0404b38bdf5d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.105044] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-58550c6c-a09f-469c-981b-0404b38bdf5d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.105155] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.105344] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d14b486-8771-4c96-baad-0bd018b270aa taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.105455] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d14b486-8771-4c96-baad-0bd018b270aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.105532] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d14b486-8771-4c96-baad-0bd018b270aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.105660] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d14b486-8771-4c96-baad-0bd018b270aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.105734] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d14b486-8771-4c96-baad-0bd018b270aa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.333719] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.334095] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.334095] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.334188] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.334270] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.334473] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.334593] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.334680] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.334839] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.334918] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.335014] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f is going to be updated. [ 1066.360147] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.360342] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.360390] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.360567] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.360712] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.370128] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: IN_PROGRESS for 2s [ 1066.607586] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-58550c6c-a09f-469c-981b-0404b38bdf5d taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.607715] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.607931] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4d14b486-8771-4c96-baad-0bd018b270aa with status ACTIVE [ 1066.608235] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.608401] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.608835] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.609115] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.609212] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.609440] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.609578] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.609698] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.609860] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.609939] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.610141] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.610234] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.610305] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.610450] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.610525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.610635] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4d14b486-8771-4c96-baad-0bd018b270aa is going to be updated. [ 1066.635743] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.635964] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.635964] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.636177] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.636316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.636472] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d14b486-8771-4c96-baad-0bd018b270aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.879859] env[70520]: INFO networking_nsxv3.common.synchronization [req-acdcd2fc-80b1-44de-b1fc-d052f2793750 req-767d0320-0dde-4d38-acfb-96806fcc0481 tempest-InstanceActionsV221TestJSON-203932902 tempest-InstanceActionsV221TestJSON-203932902-project-member] Enqueued Resource ID: 817afef8-2b10-4463-a0ad-bc691b622f6f with Priority: HIGHEST for action security_group_members [ 1066.880397] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 817afef8-2b10-4463-a0ad-bc691b622f6f with Priority: HIGHEST for action security_group_members [ 1066.880710] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-817afef8-2b10-4463-a0ad-bc691b622f6f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.880829] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-817afef8-2b10-4463-a0ad-bc691b622f6f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.880948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-817afef8-2b10-4463-a0ad-bc691b622f6f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.881483] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-817afef8-2b10-4463-a0ad-bc691b622f6f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.881643] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.881775] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.881839] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.882047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.882047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.882142] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('817afef8-2b10-4463-a0ad-bc691b622f6f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.272415] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-67 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.274025] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-67" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.274025] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-67" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.274025] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-67" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.274025] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.274025] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.274025] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.274469] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.274725] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.275165] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1067.275426] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1067.275674] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1067.275893] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1067.276133] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1067.276833] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1067.276833] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1067.294740] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1067.294918] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1067.295109] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1067.295277] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-67" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.295627] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-2b5f58f4-3d95-40cf-b9e9-84ad3bf00fd2 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.295809] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-2b5f58f4-3d95-40cf-b9e9-84ad3bf00fd2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.295931] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-2b5f58f4-3d95-40cf-b9e9-84ad3bf00fd2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.296281] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-2b5f58f4-3d95-40cf-b9e9-84ad3bf00fd2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.296430] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b5f58f4-3d95-40cf-b9e9-84ad3bf00fd2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.384954] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.385350] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.385350] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.385444] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.385489] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.385685] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.385787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.385827] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.385975] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.386061] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.386146] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 817afef8-2b10-4463-a0ad-bc691b622f6f already deleted. [ 1067.386266] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-817afef8-2b10-4463-a0ad-bc691b622f6f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.767056] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58550c6c-a09f-469c-981b-0404b38bdf5d in Status: SUCCESS [ 1067.767056] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.767056] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.767056] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.767056] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.767056] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.767447] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.767447] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.767447] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.767447] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58550c6c-a09f-469c-981b-0404b38bdf5d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.799061] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.799061] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.799345] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.799552] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.799710] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.799864] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 2b5f58f4-3d95-40cf-b9e9-84ad3bf00fd2 not found, creating... [ 1067.800157] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.800319] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.800437] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.800661] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.800797] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.801092] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.801250] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.801367] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.801573] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.801763] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.801925] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 2b5f58f4-3d95-40cf-b9e9-84ad3bf00fd2 is going to be created. [ 1067.823668] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.823910] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.824048] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.824337] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.824570] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.824795] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-2b5f58f4-3d95-40cf-b9e9-84ad3bf00fd2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.269265] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58550c6c-a09f-469c-981b-0404b38bdf5d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.380228] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: SUCCESS [ 1068.381227] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f deletion is rescheduled due to dependency. [ 1068.381227] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.581354] env[70520]: INFO networking_nsxv3.common.synchronization [req-acdcd2fc-80b1-44de-b1fc-d052f2793750 req-fb4afc15-6fe5-44da-afe6-ce0c120e1f39 service nova] Enqueued Resource ID: 817afef8-2b10-4463-a0ad-bc691b622f6f with Priority: HIGHEST for action security_group_rules [ 1068.581665] env[70520]: INFO networking_nsxv3.common.synchronization [req-acdcd2fc-80b1-44de-b1fc-d052f2793750 req-fb4afc15-6fe5-44da-afe6-ce0c120e1f39 service nova] Enqueued Resource ID: 817afef8-2b10-4463-a0ad-bc691b622f6f with Priority: HIGHEST for action security_group_members [ 1068.581761] env[70520]: INFO networking_nsxv3.common.synchronization [req-acdcd2fc-80b1-44de-b1fc-d052f2793750 req-fb4afc15-6fe5-44da-afe6-ce0c120e1f39 service nova] Enqueued Resource ID: 2b5f58f4-3d95-40cf-b9e9-84ad3bf00fd2 with Priority: HIGHEST for action port [ 1068.582310] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 817afef8-2b10-4463-a0ad-bc691b622f6f with Priority: HIGHEST for action security_group_rules [ 1068.582448] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 817afef8-2b10-4463-a0ad-bc691b622f6f with Priority: HIGHEST for action security_group_members [ 1068.582546] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5f58f4-3d95-40cf-b9e9-84ad3bf00fd2 with Priority: HIGHEST for action port [ 1068.582819] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-817afef8-2b10-4463-a0ad-bc691b622f6f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.582934] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-817afef8-2b10-4463-a0ad-bc691b622f6f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.583007] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-817afef8-2b10-4463-a0ad-bc691b622f6f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.587309] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-817afef8-2b10-4463-a0ad-bc691b622f6f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.587438] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('817afef8-2b10-4463-a0ad-bc691b622f6f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.588344] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-817afef8-2b10-4463-a0ad-bc691b622f6f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.588431] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-817afef8-2b10-4463-a0ad-bc691b622f6f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.588477] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-817afef8-2b10-4463-a0ad-bc691b622f6f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.588657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-817afef8-2b10-4463-a0ad-bc691b622f6f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.588806] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.588897] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.588990] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.589101] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.589182] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.589267] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('817afef8-2b10-4463-a0ad-bc691b622f6f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.590301] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b5f58f4-3d95-40cf-b9e9-84ad3bf00fd2 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.590407] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b5f58f4-3d95-40cf-b9e9-84ad3bf00fd2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.590469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b5f58f4-3d95-40cf-b9e9-84ad3bf00fd2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.590619] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b5f58f4-3d95-40cf-b9e9-84ad3bf00fd2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.590689] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b5f58f4-3d95-40cf-b9e9-84ad3bf00fd2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.774521] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58550c6c-a09f-469c-981b-0404b38bdf5d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.095671] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-817afef8-2b10-4463-a0ad-bc691b622f6f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.095813] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-817afef8-2b10-4463-a0ad-bc691b622f6f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.096038] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('817afef8-2b10-4463-a0ad-bc691b622f6f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.096915] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b5f58f4-3d95-40cf-b9e9-84ad3bf00fd2 with status ACTIVE [ 1069.097112] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.097352] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.097483] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.097690] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.097778] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.097950] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.098059] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.098121] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.098273] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.098351] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.098649] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.098773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.098813] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.098954] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.099038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.099124] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b5f58f4-3d95-40cf-b9e9-84ad3bf00fd2 is going to be updated. [ 1069.121324] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.121480] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.121571] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.121849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.122063] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.122263] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b5f58f4-3d95-40cf-b9e9-84ad3bf00fd2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.277722] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.277722] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.277722] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.277722] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.277722] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.277722] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58550c6c-a09f-469c-981b-0404b38bdf5d is going to be updated. [ 1069.320289] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.320488] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.320533] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.321070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.321070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.332931] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58550c6c-a09f-469c-981b-0404b38bdf5d in Status: IN_PROGRESS for 2s [ 1069.601080] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('817afef8-2b10-4463-a0ad-bc691b622f6f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.107701] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.107701] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.107701] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.107701] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.107701] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.107701] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 817afef8-2b10-4463-a0ad-bc691b622f6f is going to be created. [ 1070.182976] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.182976] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.182976] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.182976] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.182976] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.203810] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 817afef8-2b10-4463-a0ad-bc691b622f6f in Status: UNINITIALIZED for 2s [ 1071.345629] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58550c6c-a09f-469c-981b-0404b38bdf5d in Status: SUCCESS [ 1071.345629] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.345925] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.346162] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.346439] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.346607] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.346688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.347215] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.347215] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.347215] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.347215] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58550c6c-a09f-469c-981b-0404b38bdf5d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.413129] env[70520]: INFO networking_nsxv3.common.synchronization [req-0b34ad68-801b-4ee2-bb14-16d6e1085c85 req-f037b267-ae12-45ec-b13a-ea1e5b5cb21b tempest-AttachInterfacesTestJSON-1687744298 tempest-AttachInterfacesTestJSON-1687744298-project-member] Enqueued Resource ID: 9d478320-7685-43e1-8bec-cd33229a3a3f with Priority: HIGHEST for action security_group_members [ 1071.413129] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d478320-7685-43e1-8bec-cd33229a3a3f with Priority: HIGHEST for action security_group_members [ 1071.413129] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d478320-7685-43e1-8bec-cd33229a3a3f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.413392] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d478320-7685-43e1-8bec-cd33229a3a3f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.413392] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d478320-7685-43e1-8bec-cd33229a3a3f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.414200] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d478320-7685-43e1-8bec-cd33229a3a3f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.414200] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.414200] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.414200] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.414776] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.414891] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.415050] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d478320-7685-43e1-8bec-cd33229a3a3f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.781318] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-631 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.781551] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.781676] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.781987] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.782677] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.782922] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.783084] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.783323] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.783483] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.783706] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1071.783840] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1071.784031] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1071.784161] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1071.784284] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1071.784395] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1071.784540] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1071.807082] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1071.807293] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1071.807500] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1071.807857] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.808220] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-0355096f-1620-45c2-a2c6-187cec902917 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.808426] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-0355096f-1620-45c2-a2c6-187cec902917" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.808601] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-0355096f-1620-45c2-a2c6-187cec902917" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.809137] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-0355096f-1620-45c2-a2c6-187cec902917" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.809293] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0355096f-1620-45c2-a2c6-187cec902917',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.852118] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-58550c6c-a09f-469c-981b-0404b38bdf5d taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.852118] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.852296] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.852623] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.852874] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.852994] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.853080] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.853286] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.853376] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.853469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.853625] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-58550c6c-a09f-469c-981b-0404b38bdf5d taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.853728] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.853794] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.853909] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.854187] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.854187] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.854187] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.854324] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.854403] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.854461] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.854551] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58550c6c-a09f-469c-981b-0404b38bdf5d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.919632] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.919816] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.919885] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.920120] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.920209] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.920408] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.920515] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.920604] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.920811] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.920890] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.920977] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d478320-7685-43e1-8bec-cd33229a3a3f already deleted. [ 1071.921079] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d478320-7685-43e1-8bec-cd33229a3a3f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.214814] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 817afef8-2b10-4463-a0ad-bc691b622f6f in Status: SUCCESS [ 1072.215102] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-817afef8-2b10-4463-a0ad-bc691b622f6f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.215269] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-817afef8-2b10-4463-a0ad-bc691b622f6f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.215504] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-817afef8-2b10-4463-a0ad-bc691b622f6f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.215692] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.215821] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.215879] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.216081] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.216178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.216262] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-817afef8-2b10-4463-a0ad-bc691b622f6f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.216362] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('817afef8-2b10-4463-a0ad-bc691b622f6f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.313029] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.313029] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.313029] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.313029] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.313029] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.313029] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 0355096f-1620-45c2-a2c6-187cec902917 not found, creating... [ 1072.313029] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.313443] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.313443] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.313443] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.314449] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.314449] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.314449] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.314449] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.314449] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.314449] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.314915] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 0355096f-1620-45c2-a2c6-187cec902917 is going to be created. [ 1072.334414] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.334632] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.334755] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.335023] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.335255] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.335503] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-0355096f-1620-45c2-a2c6-187cec902917" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.357364] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58550c6c-a09f-469c-981b-0404b38bdf5d: rpc.has_security_group_logging(os_id): False [ 1072.375203] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.375399] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.375466] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.375626] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.375716] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.375902] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.376020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.376187] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.376272] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.376272] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.376491] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.376568] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.376618] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.376775] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.376808] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.376976] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.377072] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.377125] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.377251] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.377322] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.377459] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58550c6c-a09f-469c-981b-0404b38bdf5d is going to be updated. [ 1072.466650] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.466766] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.466844] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.467065] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.467215] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.485434] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58550c6c-a09f-469c-981b-0404b38bdf5d in Status: IN_PROGRESS for 2s [ 1072.719290] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-817afef8-2b10-4463-a0ad-bc691b622f6f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.719290] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-817afef8-2b10-4463-a0ad-bc691b622f6f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.719428] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-817afef8-2b10-4463-a0ad-bc691b622f6f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.719561] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-817afef8-2b10-4463-a0ad-bc691b622f6f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.719676] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.719773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.719832] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.719981] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.720076] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.720163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-817afef8-2b10-4463-a0ad-bc691b622f6f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.720321] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-817afef8-2b10-4463-a0ad-bc691b622f6f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.720432] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-817afef8-2b10-4463-a0ad-bc691b622f6f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.720494] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-817afef8-2b10-4463-a0ad-bc691b622f6f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.720635] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-817afef8-2b10-4463-a0ad-bc691b622f6f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.720766] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.720854] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.720911] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.721080] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.721152] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.721229] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-817afef8-2b10-4463-a0ad-bc691b622f6f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.721314] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('817afef8-2b10-4463-a0ad-bc691b622f6f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.132559] env[70520]: INFO networking_nsxv3.common.synchronization [req-0b34ad68-801b-4ee2-bb14-16d6e1085c85 req-c6625429-4834-412e-b5fe-1349dec8fc7d service nova] Enqueued Resource ID: 9d478320-7685-43e1-8bec-cd33229a3a3f with Priority: HIGHEST for action security_group_rules [ 1073.132559] env[70520]: INFO networking_nsxv3.common.synchronization [req-0b34ad68-801b-4ee2-bb14-16d6e1085c85 req-c6625429-4834-412e-b5fe-1349dec8fc7d service nova] Enqueued Resource ID: 9d478320-7685-43e1-8bec-cd33229a3a3f with Priority: HIGHEST for action security_group_members [ 1073.132559] env[70520]: INFO networking_nsxv3.common.synchronization [req-0b34ad68-801b-4ee2-bb14-16d6e1085c85 req-c6625429-4834-412e-b5fe-1349dec8fc7d service nova] Enqueued Resource ID: 0355096f-1620-45c2-a2c6-187cec902917 with Priority: HIGHEST for action port [ 1073.132559] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d478320-7685-43e1-8bec-cd33229a3a3f with Priority: HIGHEST for action security_group_rules [ 1073.132559] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d478320-7685-43e1-8bec-cd33229a3a3f with Priority: HIGHEST for action security_group_members [ 1073.132559] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0355096f-1620-45c2-a2c6-187cec902917 with Priority: HIGHEST for action port [ 1073.132855] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d478320-7685-43e1-8bec-cd33229a3a3f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.132943] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d478320-7685-43e1-8bec-cd33229a3a3f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.132943] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d478320-7685-43e1-8bec-cd33229a3a3f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.133152] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d478320-7685-43e1-8bec-cd33229a3a3f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.133227] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d478320-7685-43e1-8bec-cd33229a3a3f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.134080] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d478320-7685-43e1-8bec-cd33229a3a3f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.134220] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d478320-7685-43e1-8bec-cd33229a3a3f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.134261] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d478320-7685-43e1-8bec-cd33229a3a3f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.134430] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d478320-7685-43e1-8bec-cd33229a3a3f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.134572] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.134662] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.134718] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.134853] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.134932] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.135028] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d478320-7685-43e1-8bec-cd33229a3a3f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.135962] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-0355096f-1620-45c2-a2c6-187cec902917 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.136106] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0355096f-1620-45c2-a2c6-187cec902917" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.136164] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0355096f-1620-45c2-a2c6-187cec902917" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.138029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0355096f-1620-45c2-a2c6-187cec902917" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.138029] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0355096f-1620-45c2-a2c6-187cec902917',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.224637] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 817afef8-2b10-4463-a0ad-bc691b622f6f: rpc.has_security_group_logging(os_id): False [ 1073.241345] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.241345] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.241345] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.241345] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.241345] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.241581] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.241634] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.241669] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.241797] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.241870] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.242066] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.242164] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.242212] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.242790] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.242790] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.242790] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.242790] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.242790] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.243078] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.243078] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.243149] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 817afef8-2b10-4463-a0ad-bc691b622f6f is going to be created. [ 1073.306877] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.307074] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.307182] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.307530] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.307795] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.322698] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 817afef8-2b10-4463-a0ad-bc691b622f6f in Status: IN_PROGRESS for 2s [ 1073.639706] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d478320-7685-43e1-8bec-cd33229a3a3f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.639706] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d478320-7685-43e1-8bec-cd33229a3a3f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.640081] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d478320-7685-43e1-8bec-cd33229a3a3f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.644223] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0355096f-1620-45c2-a2c6-187cec902917 with status ACTIVE [ 1073.644332] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.644432] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.644497] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.644692] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.644780] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.644935] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.645171] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.645266] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.645442] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.645553] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.645730] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.645828] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.645901] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.646351] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.646470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.646767] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0355096f-1620-45c2-a2c6-187cec902917 is going to be updated. [ 1073.677200] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.677360] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.677462] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.677692] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.677965] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.678225] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0355096f-1620-45c2-a2c6-187cec902917" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.061830] env[70520]: INFO networking_nsxv3.common.synchronization [req-19301ad2-32a1-4d0c-a102-b978cc275325 req-a2c76b5b-c48b-4a77-b837-b53e85a82d61 tempest-ImagesTestJSON-1211196503 tempest-ImagesTestJSON-1211196503-project-member] Enqueued Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1074.062402] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1074.062705] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.062825] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.062891] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.063096] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.063242] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.063337] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.063397] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.063635] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.063752] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.063843] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.147418] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d478320-7685-43e1-8bec-cd33229a3a3f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.482232] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-29 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.482232] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-29" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.482496] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-29" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.482580] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-29" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.486024] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.486024] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.486024] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.486024] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.486024] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.486024] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1074.486024] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1074.486024] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1074.486024] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1074.486024] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1074.486024] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1074.486024] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1074.501991] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58550c6c-a09f-469c-981b-0404b38bdf5d in Status: SUCCESS [ 1074.503533] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.507333] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1074.507333] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1074.507592] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1074.507699] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-29" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.508028] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-5c8cae08-4eb1-4ea1-ba14-0bce70fa68ed taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.508197] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-5c8cae08-4eb1-4ea1-ba14-0bce70fa68ed" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.508321] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-5c8cae08-4eb1-4ea1-ba14-0bce70fa68ed" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.509122] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-5c8cae08-4eb1-4ea1-ba14-0bce70fa68ed" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.509122] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c8cae08-4eb1-4ea1-ba14-0bce70fa68ed',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.566161] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.566370] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.566441] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.566684] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.566773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.566983] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.567096] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.567152] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.567311] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.567388] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.567531] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 is going to be updated. [ 1074.593971] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.594181] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.594318] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.594970] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.595181] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.610054] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: IN_PROGRESS for 2s [ 1074.652739] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.652739] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.652739] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.652739] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.652739] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.652739] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d478320-7685-43e1-8bec-cd33229a3a3f is going to be created. [ 1074.689524] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.689524] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.689524] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.689678] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.689888] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.700318] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d478320-7685-43e1-8bec-cd33229a3a3f in Status: UNINITIALIZED for 2s [ 1075.012800] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.012949] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.015018] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.015018] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.015018] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.015018] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 5c8cae08-4eb1-4ea1-ba14-0bce70fa68ed not found, creating... [ 1075.015018] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.015018] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.015018] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.015018] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.015018] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.015549] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.015549] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.015639] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.015860] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.016024] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.016173] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 5c8cae08-4eb1-4ea1-ba14-0bce70fa68ed is going to be created. [ 1075.050435] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.050791] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.051083] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.051383] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.051571] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.051789] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-5c8cae08-4eb1-4ea1-ba14-0bce70fa68ed" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.336804] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 817afef8-2b10-4463-a0ad-bc691b622f6f in Status: SUCCESS [ 1075.337030] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-817afef8-2b10-4463-a0ad-bc691b622f6f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.792744] env[70520]: INFO networking_nsxv3.common.synchronization [req-19301ad2-32a1-4d0c-a102-b978cc275325 req-9eee5657-3502-4064-bd0f-eb0c18dc7a30 service nova] Enqueued Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_rules [ 1075.792976] env[70520]: INFO networking_nsxv3.common.synchronization [req-19301ad2-32a1-4d0c-a102-b978cc275325 req-9eee5657-3502-4064-bd0f-eb0c18dc7a30 service nova] Enqueued Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1075.793073] env[70520]: INFO networking_nsxv3.common.synchronization [req-19301ad2-32a1-4d0c-a102-b978cc275325 req-9eee5657-3502-4064-bd0f-eb0c18dc7a30 service nova] Enqueued Resource ID: 5c8cae08-4eb1-4ea1-ba14-0bce70fa68ed with Priority: HIGHEST for action port [ 1075.793716] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_rules [ 1075.793828] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1075.793939] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c8cae08-4eb1-4ea1-ba14-0bce70fa68ed with Priority: HIGHEST for action port [ 1075.794326] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.794498] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.794634] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.794886] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.794984] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.796334] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.796481] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.796727] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c8cae08-4eb1-4ea1-ba14-0bce70fa68ed taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.796835] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c8cae08-4eb1-4ea1-ba14-0bce70fa68ed" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.796903] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c8cae08-4eb1-4ea1-ba14-0bce70fa68ed" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.797128] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c8cae08-4eb1-4ea1-ba14-0bce70fa68ed" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.797225] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c8cae08-4eb1-4ea1-ba14-0bce70fa68ed',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.299043] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.299186] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.302180] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5c8cae08-4eb1-4ea1-ba14-0bce70fa68ed with status ACTIVE [ 1076.302180] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.302372] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.302372] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.302747] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.302849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.303065] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.303235] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.303301] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.303467] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.303578] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.305688] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.305688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.305688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.305688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.305688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.305688] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5c8cae08-4eb1-4ea1-ba14-0bce70fa68ed is going to be updated. [ 1076.332810] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.332810] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.332810] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.332810] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.332810] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.332810] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c8cae08-4eb1-4ea1-ba14-0bce70fa68ed" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.622430] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: SUCCESS [ 1076.622430] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 deletion is rescheduled due to dependency. [ 1076.622430] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.622430] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.622430] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.622430] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.622430] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.622430] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.622430] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.622430] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.622430] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.709855] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d478320-7685-43e1-8bec-cd33229a3a3f in Status: SUCCESS [ 1076.710134] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d478320-7685-43e1-8bec-cd33229a3a3f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.710316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d478320-7685-43e1-8bec-cd33229a3a3f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.710503] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d478320-7685-43e1-8bec-cd33229a3a3f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.710694] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.711060] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.711060] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.711172] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.711330] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.711438] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d478320-7685-43e1-8bec-cd33229a3a3f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.711528] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d478320-7685-43e1-8bec-cd33229a3a3f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.126701] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.193715] env[70520]: INFO networking_nsxv3.common.synchronization [req-4da63611-fd69-47c7-b24d-1e89046b20a3 req-2f68c4a5-fcba-42b2-ade9-ffe6d20c1364 tempest-AttachVolumeNegativeTest-1224878754 tempest-AttachVolumeNegativeTest-1224878754-project-member] Enqueued Resource ID: da040ed9-9da1-43c9-b672-1e4e957ffa6c with Priority: HIGHEST for action security_group_members [ 1077.194546] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da040ed9-9da1-43c9-b672-1e4e957ffa6c with Priority: HIGHEST for action security_group_members [ 1077.195054] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-da040ed9-9da1-43c9-b672-1e4e957ffa6c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.195054] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da040ed9-9da1-43c9-b672-1e4e957ffa6c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.195054] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da040ed9-9da1-43c9-b672-1e4e957ffa6c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.195226] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da040ed9-9da1-43c9-b672-1e4e957ffa6c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.195454] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.195565] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.195648] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.195805] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.195909] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.197021] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da040ed9-9da1-43c9-b672-1e4e957ffa6c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.213351] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d478320-7685-43e1-8bec-cd33229a3a3f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.629780] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.700434] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.700608] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.700702] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.700906] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.701009] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.701218] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.701319] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.701382] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.701600] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.701732] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.701848] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da040ed9-9da1-43c9-b672-1e4e957ffa6c is going to be updated. [ 1077.715841] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d478320-7685-43e1-8bec-cd33229a3a3f: rpc.has_security_group_logging(os_id): False [ 1077.734583] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.734737] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.734803] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.735054] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.735212] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.737945] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.737945] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.737945] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.737945] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.737945] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.737945] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.737945] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.737945] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.737945] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.737945] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.739971] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d478320-7685-43e1-8bec-cd33229a3a3f is going to be created. [ 1077.749132] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da040ed9-9da1-43c9-b672-1e4e957ffa6c in Status: IN_PROGRESS for 2s [ 1077.797957] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.798128] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.798194] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.798386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.798561] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.811231] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d478320-7685-43e1-8bec-cd33229a3a3f in Status: IN_PROGRESS for 2s [ 1078.140027] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.140027] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.140027] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.140027] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.140027] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.140027] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 is going to be updated. [ 1078.175991] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.176162] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.176698] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.176698] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.176901] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.187207] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: IN_PROGRESS for 2s [ 1078.431450] env[70520]: INFO networking_nsxv3.common.synchronization [req-57f20864-f2f5-4f65-ae37-05a72a40a11c req-f2626e9d-3129-4869-97fc-e444bd402605 tempest-InstanceActionsV221TestJSON-203932902 tempest-InstanceActionsV221TestJSON-203932902-project-member] Enqueued Resource ID: 817afef8-2b10-4463-a0ad-bc691b622f6f with Priority: HIGHEST for action security_group_members [ 1078.432485] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 817afef8-2b10-4463-a0ad-bc691b622f6f with Priority: HIGHEST for action security_group_members [ 1078.432485] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-817afef8-2b10-4463-a0ad-bc691b622f6f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.432485] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-817afef8-2b10-4463-a0ad-bc691b622f6f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.432485] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-817afef8-2b10-4463-a0ad-bc691b622f6f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.432742] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-817afef8-2b10-4463-a0ad-bc691b622f6f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.432782] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.432852] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.432907] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.435519] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.435627] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.435725] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('817afef8-2b10-4463-a0ad-bc691b622f6f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.709314] env[70520]: INFO networking_nsxv3.common.synchronization [req-f7882c95-f97b-4e7e-8d54-c0d39e58b9a9 req-8227ae63-955d-4386-b4fa-65929ac00d50 tempest-ServersTestJSON-589199853 tempest-ServersTestJSON-589199853-project-member] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1078.709532] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1078.709830] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.709984] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.709984] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.710169] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.710602] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.710602] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.710602] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.710781] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.710781] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.710848] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.938528] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.938725] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.938846] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.938992] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.939660] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.939660] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.939660] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.939660] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.939660] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.939879] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.939911] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 817afef8-2b10-4463-a0ad-bc691b622f6f is going to be updated. [ 1078.973213] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.973952] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.973952] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.973952] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.973952] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.984645] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 817afef8-2b10-4463-a0ad-bc691b622f6f in Status: IN_PROGRESS for 2s [ 1079.139895] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-831 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.140121] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-831" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.140404] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-831" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.140704] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-831" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.140805] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.140923] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.141048] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.141272] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.141418] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.141650] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1079.142198] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1079.142198] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1079.142198] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1079.142198] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1079.142198] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1079.142388] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1079.166396] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1079.166610] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1079.166813] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1079.167057] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-831" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.167536] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-7719ce38-6d50-4f6f-bbc3-ce84dcce4126 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.167897] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-7719ce38-6d50-4f6f-bbc3-ce84dcce4126" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.168228] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-7719ce38-6d50-4f6f-bbc3-ce84dcce4126" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.168703] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-7719ce38-6d50-4f6f-bbc3-ce84dcce4126" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.168835] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7719ce38-6d50-4f6f-bbc3-ce84dcce4126',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.216216] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.671766] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.672052] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.672269] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.672591] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.672771] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.672929] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 7719ce38-6d50-4f6f-bbc3-ce84dcce4126 not found, creating... [ 1079.674254] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.674254] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.674254] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.674254] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.674254] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.674526] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.674526] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.674727] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.675417] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.675417] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.675417] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 7719ce38-6d50-4f6f-bbc3-ce84dcce4126 is going to be created. [ 1079.697870] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.697870] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.697870] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.698042] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.698252] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.698514] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-7719ce38-6d50-4f6f-bbc3-ce84dcce4126" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.720144] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.776626] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da040ed9-9da1-43c9-b672-1e4e957ffa6c in Status: SUCCESS [ 1079.776828] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da040ed9-9da1-43c9-b672-1e4e957ffa6c deletion is rescheduled due to dependency. [ 1079.776919] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da040ed9-9da1-43c9-b672-1e4e957ffa6c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.830516] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d478320-7685-43e1-8bec-cd33229a3a3f in Status: SUCCESS [ 1079.830516] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d478320-7685-43e1-8bec-cd33229a3a3f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.202420] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: SUCCESS [ 1080.202895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.202895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.203090] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.203567] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.203567] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.203786] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.203924] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.204051] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.204172] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.204333] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.223225] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.223611] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.223712] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.223977] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.224101] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.224226] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be updated. [ 1080.265271] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.265271] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.265271] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.265271] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.265271] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.275890] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: IN_PROGRESS for 2s [ 1080.502883] env[70520]: INFO networking_nsxv3.common.synchronization [req-f7882c95-f97b-4e7e-8d54-c0d39e58b9a9 req-b76f6600-c35f-46d8-bb12-e8cd66353ba0 service nova] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_rules [ 1080.502883] env[70520]: INFO networking_nsxv3.common.synchronization [req-f7882c95-f97b-4e7e-8d54-c0d39e58b9a9 req-b76f6600-c35f-46d8-bb12-e8cd66353ba0 service nova] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1080.502883] env[70520]: INFO networking_nsxv3.common.synchronization [req-f7882c95-f97b-4e7e-8d54-c0d39e58b9a9 req-b76f6600-c35f-46d8-bb12-e8cd66353ba0 service nova] Enqueued Resource ID: 7719ce38-6d50-4f6f-bbc3-ce84dcce4126 with Priority: HIGHEST for action port [ 1080.503186] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_rules [ 1080.503321] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1080.503405] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7719ce38-6d50-4f6f-bbc3-ce84dcce4126 with Priority: HIGHEST for action port [ 1080.505880] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.505880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.505880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.505880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.505880] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.505880] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.505880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.505880] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-7719ce38-6d50-4f6f-bbc3-ce84dcce4126 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.505880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7719ce38-6d50-4f6f-bbc3-ce84dcce4126" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.505880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7719ce38-6d50-4f6f-bbc3-ce84dcce4126" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.505880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7719ce38-6d50-4f6f-bbc3-ce84dcce4126" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.505880] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7719ce38-6d50-4f6f-bbc3-ce84dcce4126',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.707174] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.707332] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.707380] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.708054] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.708054] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.708054] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.708275] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.708345] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.708501] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.708609] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.708821] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.708955] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.709060] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.709277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.709474] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.709612] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.709706] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.709904] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.710027] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.710149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.710276] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.980284] env[70520]: INFO networking_nsxv3.common.synchronization [req-82c82b9f-f786-46f6-b634-a271442c408b req-2bd66ec4-17b5-44bb-a152-276565236465 tempest-ServerAddressesNegativeTestJSON-920979130 tempest-ServerAddressesNegativeTestJSON-920979130-project-member] Enqueued Resource ID: c5c80f62-f996-4458-84d5-6fced2d8e47d with Priority: HIGHEST for action security_group_members [ 1080.981011] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c80f62-f996-4458-84d5-6fced2d8e47d with Priority: HIGHEST for action security_group_members [ 1080.981330] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c80f62-f996-4458-84d5-6fced2d8e47d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.981453] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.981518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.981795] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.981929] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.982039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.982103] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.982249] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.982331] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.982448] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c80f62-f996-4458-84d5-6fced2d8e47d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.998069] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 817afef8-2b10-4463-a0ad-bc691b622f6f in Status: SUCCESS [ 1080.998069] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 817afef8-2b10-4463-a0ad-bc691b622f6f deletion is rescheduled due to dependency. [ 1080.998069] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-817afef8-2b10-4463-a0ad-bc691b622f6f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.007912] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.007912] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.009187] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7719ce38-6d50-4f6f-bbc3-ce84dcce4126 with status ACTIVE [ 1081.011241] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.011241] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.011241] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.011241] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.011241] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.011241] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.011241] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.011241] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.011241] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.011241] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.011241] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.011241] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.011241] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.011725] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.011725] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.011725] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7719ce38-6d50-4f6f-bbc3-ce84dcce4126 is going to be updated. [ 1081.036585] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.036787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.036787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.037061] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.037275] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.038343] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7719ce38-6d50-4f6f-bbc3-ce84dcce4126" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.213031] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 468bd631-24dc-43d9-8a0f-93dcf753e208: rpc.has_security_group_logging(os_id): False [ 1081.256181] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.256366] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.256470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.256697] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.256811] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.257020] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.257118] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.257176] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.257335] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.257409] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.257628] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.258208] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.258208] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.258208] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.258208] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.258501] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.258581] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.258625] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.259727] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.259727] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.259727] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 is going to be updated. [ 1081.344591] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.344756] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.344827] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.345090] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.345284] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.359980] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: IN_PROGRESS for 2s [ 1081.379494] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-406 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.379806] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-406" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.379994] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-406" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.380467] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-406" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.381297] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.381576] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.381758] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.382098] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.382304] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.382591] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1081.382760] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1081.382918] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1081.383089] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1081.383254] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1081.383411] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1081.383607] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1081.407342] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1081.407536] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1081.407933] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1081.407933] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-406" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.408222] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-0f9238f4-7a0f-4d92-913e-d2d02b6a1e75 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.408400] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-0f9238f4-7a0f-4d92-913e-d2d02b6a1e75" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.408539] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-0f9238f4-7a0f-4d92-913e-d2d02b6a1e75" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.408892] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-0f9238f4-7a0f-4d92-913e-d2d02b6a1e75" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.409052] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f9238f4-7a0f-4d92-913e-d2d02b6a1e75',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.484332] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.484511] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.484632] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.484850] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.484957] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.485175] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.485295] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.485364] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.485527] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.485627] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.485713] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c80f62-f996-4458-84d5-6fced2d8e47d already deleted. [ 1081.485792] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.911954] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.913467] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.913467] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.913467] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.913467] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.913467] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 0f9238f4-7a0f-4d92-913e-d2d02b6a1e75 not found, creating... [ 1081.913467] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.915021] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.915021] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.915399] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.915623] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.916097] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.916335] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.916502] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.916780] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.917683] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.917899] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 0f9238f4-7a0f-4d92-913e-d2d02b6a1e75 is going to be created. [ 1081.941913] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.942172] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.942341] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.942578] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.942820] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.943056] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-0f9238f4-7a0f-4d92-913e-d2d02b6a1e75" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.286143] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: SUCCESS [ 1082.286432] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.286552] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.286900] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.287101] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.287240] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.287309] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.287465] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.287573] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.287683] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.790624] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.916255] env[70520]: INFO networking_nsxv3.common.synchronization [req-82c82b9f-f786-46f6-b634-a271442c408b req-5eaf8854-9314-4077-a951-5439af545267 service nova] Enqueued Resource ID: c5c80f62-f996-4458-84d5-6fced2d8e47d with Priority: HIGHEST for action security_group_rules [ 1082.916255] env[70520]: INFO networking_nsxv3.common.synchronization [req-82c82b9f-f786-46f6-b634-a271442c408b req-5eaf8854-9314-4077-a951-5439af545267 service nova] Enqueued Resource ID: c5c80f62-f996-4458-84d5-6fced2d8e47d with Priority: HIGHEST for action security_group_members [ 1082.916255] env[70520]: INFO networking_nsxv3.common.synchronization [req-82c82b9f-f786-46f6-b634-a271442c408b req-5eaf8854-9314-4077-a951-5439af545267 service nova] Enqueued Resource ID: 0f9238f4-7a0f-4d92-913e-d2d02b6a1e75 with Priority: HIGHEST for action port [ 1082.916255] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c80f62-f996-4458-84d5-6fced2d8e47d with Priority: HIGHEST for action security_group_rules [ 1082.916255] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c80f62-f996-4458-84d5-6fced2d8e47d with Priority: HIGHEST for action security_group_members [ 1082.916255] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f9238f4-7a0f-4d92-913e-d2d02b6a1e75 with Priority: HIGHEST for action port [ 1082.917787] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5c80f62-f996-4458-84d5-6fced2d8e47d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.917870] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.917939] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.918853] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.918853] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5c80f62-f996-4458-84d5-6fced2d8e47d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.919419] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c80f62-f996-4458-84d5-6fced2d8e47d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.919419] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.919578] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.923297] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.923972] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.923972] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.923972] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.923972] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.923972] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.923972] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c80f62-f996-4458-84d5-6fced2d8e47d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.924954] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f9238f4-7a0f-4d92-913e-d2d02b6a1e75 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.925083] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f9238f4-7a0f-4d92-913e-d2d02b6a1e75" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.925083] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f9238f4-7a0f-4d92-913e-d2d02b6a1e75" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.925246] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f9238f4-7a0f-4d92-913e-d2d02b6a1e75" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.925320] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f9238f4-7a0f-4d92-913e-d2d02b6a1e75',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.296406] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.374297] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: SUCCESS [ 1083.374550] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.427869] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c80f62-f996-4458-84d5-6fced2d8e47d taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.428020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.428257] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5c80f62-f996-4458-84d5-6fced2d8e47d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.429710] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f9238f4-7a0f-4d92-913e-d2d02b6a1e75 with status ACTIVE [ 1083.430058] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.430305] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.430479] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.430725] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.430871] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.431054] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.431194] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.431315] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.431556] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.431657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.431880] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.432390] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.432390] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.432390] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.432390] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.432390] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f9238f4-7a0f-4d92-913e-d2d02b6a1e75 is going to be updated. [ 1083.462027] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.462186] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.462254] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.462466] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.462596] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.462781] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f9238f4-7a0f-4d92-913e-d2d02b6a1e75" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.701833] env[70520]: INFO networking_nsxv3.common.synchronization [req-21b982ec-b806-4ac6-9c03-9cc8a3034bf2 req-0f1ecb03-aad3-498f-ab70-ce391ffad7d6 tempest-ServerActionsTestOtherA-325270290 tempest-ServerActionsTestOtherA-325270290-project-member] Enqueued Resource ID: 049500dd-1e0c-481a-b7e8-f7bc25741086 with Priority: HIGHEST for action security_group_members [ 1083.702410] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 049500dd-1e0c-481a-b7e8-f7bc25741086 with Priority: HIGHEST for action security_group_members [ 1083.702722] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-049500dd-1e0c-481a-b7e8-f7bc25741086 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.702843] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-049500dd-1e0c-481a-b7e8-f7bc25741086" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.702908] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-049500dd-1e0c-481a-b7e8-f7bc25741086" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.703659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-049500dd-1e0c-481a-b7e8-f7bc25741086" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.703831] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.703938] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.704029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.704198] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.704282] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.704373] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('049500dd-1e0c-481a-b7e8-f7bc25741086',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.801442] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.801607] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.801679] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.801895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.802016] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.802120] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be updated. [ 1083.831288] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.831448] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.831494] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.831699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.831883] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.841300] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: IN_PROGRESS for 2s [ 1083.934251] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5c80f62-f996-4458-84d5-6fced2d8e47d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.091368] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-572 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.091741] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-572" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.091927] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-572" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.092214] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-572" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.092466] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.092620] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.092733] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.093415] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.093616] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.093887] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1084.094257] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1084.094404] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1084.094646] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1084.094829] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1084.095057] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1084.095215] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1084.115934] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1084.115934] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1084.115934] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1084.115934] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-572" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.115934] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-8246815d-f3a5-47dd-bb3c-05882e9da8f9 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.115934] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-8246815d-f3a5-47dd-bb3c-05882e9da8f9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.115934] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-8246815d-f3a5-47dd-bb3c-05882e9da8f9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.115934] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-8246815d-f3a5-47dd-bb3c-05882e9da8f9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.115934] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8246815d-f3a5-47dd-bb3c-05882e9da8f9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.206265] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.206494] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.206494] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.206621] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.206868] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.207087] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.207276] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.207276] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.207420] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.207464] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.207574] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 049500dd-1e0c-481a-b7e8-f7bc25741086 already deleted. [ 1084.207672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-049500dd-1e0c-481a-b7e8-f7bc25741086" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.436780] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.437176] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.437176] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.437176] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.437314] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.437350] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c80f62-f996-4458-84d5-6fced2d8e47d is going to be created. [ 1084.464482] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.464651] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.464757] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.465404] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.465404] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.474850] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c80f62-f996-4458-84d5-6fced2d8e47d in Status: UNINITIALIZED for 2s [ 1084.620333] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.620333] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.620678] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.622650] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.622650] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.622650] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 8246815d-f3a5-47dd-bb3c-05882e9da8f9 not found, creating... [ 1084.622650] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.622650] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.622650] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.623427] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.623427] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.623427] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.623580] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.623701] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.623952] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.624113] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.624279] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 8246815d-f3a5-47dd-bb3c-05882e9da8f9 is going to be created. [ 1084.650297] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.650872] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.650872] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.650872] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.651095] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.651323] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-8246815d-f3a5-47dd-bb3c-05882e9da8f9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.481522] env[70520]: INFO networking_nsxv3.common.synchronization [req-21b982ec-b806-4ac6-9c03-9cc8a3034bf2 req-38a1edbc-ac1c-41a7-b743-f3b35be72f4c service nova] Enqueued Resource ID: 049500dd-1e0c-481a-b7e8-f7bc25741086 with Priority: HIGHEST for action security_group_rules [ 1085.481889] env[70520]: INFO networking_nsxv3.common.synchronization [req-21b982ec-b806-4ac6-9c03-9cc8a3034bf2 req-38a1edbc-ac1c-41a7-b743-f3b35be72f4c service nova] Enqueued Resource ID: 049500dd-1e0c-481a-b7e8-f7bc25741086 with Priority: HIGHEST for action security_group_members [ 1085.481889] env[70520]: INFO networking_nsxv3.common.synchronization [req-21b982ec-b806-4ac6-9c03-9cc8a3034bf2 req-38a1edbc-ac1c-41a7-b743-f3b35be72f4c service nova] Enqueued Resource ID: 8246815d-f3a5-47dd-bb3c-05882e9da8f9 with Priority: HIGHEST for action port [ 1085.482090] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 049500dd-1e0c-481a-b7e8-f7bc25741086 with Priority: HIGHEST for action security_group_rules [ 1085.482224] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 049500dd-1e0c-481a-b7e8-f7bc25741086 with Priority: HIGHEST for action security_group_members [ 1085.482314] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8246815d-f3a5-47dd-bb3c-05882e9da8f9 with Priority: HIGHEST for action port [ 1085.482915] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-049500dd-1e0c-481a-b7e8-f7bc25741086 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.483689] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-049500dd-1e0c-481a-b7e8-f7bc25741086" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.483800] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-049500dd-1e0c-481a-b7e8-f7bc25741086" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.484014] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-049500dd-1e0c-481a-b7e8-f7bc25741086" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.484102] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('049500dd-1e0c-481a-b7e8-f7bc25741086',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.484948] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-049500dd-1e0c-481a-b7e8-f7bc25741086 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.485105] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-049500dd-1e0c-481a-b7e8-f7bc25741086" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.485151] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-049500dd-1e0c-481a-b7e8-f7bc25741086" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.485332] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-049500dd-1e0c-481a-b7e8-f7bc25741086" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.485515] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.486327] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.486327] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.486327] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.486327] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.486327] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('049500dd-1e0c-481a-b7e8-f7bc25741086',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.490288] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-8246815d-f3a5-47dd-bb3c-05882e9da8f9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.490288] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8246815d-f3a5-47dd-bb3c-05882e9da8f9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.490288] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8246815d-f3a5-47dd-bb3c-05882e9da8f9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.490288] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8246815d-f3a5-47dd-bb3c-05882e9da8f9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.490288] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8246815d-f3a5-47dd-bb3c-05882e9da8f9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.852629] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: SUCCESS [ 1085.852851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.853028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.853240] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.853431] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.853540] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.853604] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.853751] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.853829] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.853913] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.854009] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.991033] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('049500dd-1e0c-481a-b7e8-f7bc25741086',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.991726] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-049500dd-1e0c-481a-b7e8-f7bc25741086 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.992190] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-049500dd-1e0c-481a-b7e8-f7bc25741086" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.992581] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8246815d-f3a5-47dd-bb3c-05882e9da8f9 with status ACTIVE [ 1085.992765] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.992876] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.993356] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.993606] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.993705] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.993883] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.993982] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.994059] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.994230] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.994307] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.994523] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.994578] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.994620] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.994760] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.994833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.994916] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8246815d-f3a5-47dd-bb3c-05882e9da8f9 is going to be updated. [ 1086.016183] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.016354] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.016392] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.016717] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.016813] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.016973] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8246815d-f3a5-47dd-bb3c-05882e9da8f9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.191419] env[70520]: INFO networking_nsxv3.common.synchronization [req-9a93ce0f-035e-4040-8bda-ebd6585cb1f9 req-44a5964d-a11f-41a0-96c2-84fe7db0e18e tempest-ServerActionsTestJSON-420425725 tempest-ServerActionsTestJSON-420425725-project-member] Enqueued Resource ID: 4c90693a-14b7-438f-84ec-4b2ae33515d7 with Priority: HIGHEST for action security_group_members [ 1086.192855] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c90693a-14b7-438f-84ec-4b2ae33515d7 with Priority: HIGHEST for action security_group_members [ 1086.196431] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c90693a-14b7-438f-84ec-4b2ae33515d7 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.196431] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c90693a-14b7-438f-84ec-4b2ae33515d7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.196431] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c90693a-14b7-438f-84ec-4b2ae33515d7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.196431] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c90693a-14b7-438f-84ec-4b2ae33515d7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.196431] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.196431] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.196431] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.196431] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.196431] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.196431] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c90693a-14b7-438f-84ec-4b2ae33515d7',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.356542] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.356949] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.356949] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.357606] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.357606] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.357766] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.357845] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.358045] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.358434] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.358434] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.358434] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.358434] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.359901] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.359901] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.359901] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.359901] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.359901] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.359901] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.359901] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.359901] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.363099] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.485397] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c80f62-f996-4458-84d5-6fced2d8e47d in Status: SUCCESS [ 1086.485778] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.485778] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.485986] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.486311] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.486311] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.486484] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.486484] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.486576] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.486630] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.486719] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5c80f62-f996-4458-84d5-6fced2d8e47d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.493255] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('049500dd-1e0c-481a-b7e8-f7bc25741086',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.646796] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-135 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.647252] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-135" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.647525] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-135" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.647768] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-135" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.648192] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.648282] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.648408] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.648714] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.648853] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.649114] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1086.649240] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1086.649420] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1086.649573] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1086.649777] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1086.649942] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1086.650153] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1086.672141] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1086.672402] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1086.672512] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1086.672756] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-135" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.673168] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-e2b9e825-30b0-4c46-8285-9581c34a6cc8 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.673473] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-e2b9e825-30b0-4c46-8285-9581c34a6cc8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.673591] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-e2b9e825-30b0-4c46-8285-9581c34a6cc8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.673923] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-e2b9e825-30b0-4c46-8285-9581c34a6cc8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.674225] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2b9e825-30b0-4c46-8285-9581c34a6cc8',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.699431] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.699592] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.699696] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.699968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.700080] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.700293] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.700403] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.700456] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.700618] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.700683] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.700835] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c90693a-14b7-438f-84ec-4b2ae33515d7 already deleted. [ 1086.700835] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c90693a-14b7-438f-84ec-4b2ae33515d7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.867609] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a927ecd-fa02-4905-9c80-5ef71a14a848: rpc.has_security_group_logging(os_id): False [ 1086.886877] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.887071] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.887141] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.887357] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.887447] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.887713] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.887813] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.887934] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.888041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.888116] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.888361] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.888506] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.888693] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.888786] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.888841] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.889083] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.889286] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.889286] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.889527] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.889527] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.889654] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be updated. [ 1086.969987] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.970183] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.970183] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.970350] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.970519] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.985663] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: IN_PROGRESS for 2s [ 1086.989199] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c80f62-f996-4458-84d5-6fced2d8e47d taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.989349] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.989395] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.989768] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.989768] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.989896] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.989896] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.990054] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.990140] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.990225] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.990393] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c80f62-f996-4458-84d5-6fced2d8e47d taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.990458] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.990518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.990654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.990786] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.990874] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.990932] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.991078] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.991238] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.991238] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.991322] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5c80f62-f996-4458-84d5-6fced2d8e47d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.994855] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.994968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.995050] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.995203] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.995280] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.995367] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 049500dd-1e0c-481a-b7e8-f7bc25741086 is going to be created. [ 1087.021843] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.022088] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.022182] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.022432] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.022622] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.038035] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 049500dd-1e0c-481a-b7e8-f7bc25741086 in Status: UNINITIALIZED for 2s [ 1087.176935] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.178047] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.178047] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.178047] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.178242] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.178329] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port e2b9e825-30b0-4c46-8285-9581c34a6cc8 not found, creating... [ 1087.180088] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.180088] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.180088] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.180088] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.180088] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.180088] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.180088] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.180088] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.180088] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.180612] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.180612] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: e2b9e825-30b0-4c46-8285-9581c34a6cc8 is going to be created. [ 1087.205051] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.205327] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.205543] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.205896] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.206218] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.206544] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-e2b9e825-30b0-4c46-8285-9581c34a6cc8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.493522] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5c80f62-f996-4458-84d5-6fced2d8e47d: rpc.has_security_group_logging(os_id): False [ 1087.517032] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.517251] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.517304] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.517545] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.517664] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.517858] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.518428] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.518428] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.518428] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.518428] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.518688] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.518688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.518688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.518806] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.518806] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.518974] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.519120] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.519120] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.519300] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.519349] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.519442] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5c80f62-f996-4458-84d5-6fced2d8e47d is going to be created. [ 1087.583594] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.583948] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.584076] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.584344] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.584772] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.627282] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5c80f62-f996-4458-84d5-6fced2d8e47d in Status: IN_PROGRESS for 2s [ 1088.155775] env[70520]: INFO networking_nsxv3.common.synchronization [req-9a93ce0f-035e-4040-8bda-ebd6585cb1f9 req-7a0b7f2c-df63-490a-9be7-a3d4a53aa994 service nova] Enqueued Resource ID: 4c90693a-14b7-438f-84ec-4b2ae33515d7 with Priority: HIGHEST for action security_group_rules [ 1088.155971] env[70520]: INFO networking_nsxv3.common.synchronization [req-9a93ce0f-035e-4040-8bda-ebd6585cb1f9 req-7a0b7f2c-df63-490a-9be7-a3d4a53aa994 service nova] Enqueued Resource ID: 4c90693a-14b7-438f-84ec-4b2ae33515d7 with Priority: HIGHEST for action security_group_members [ 1088.156195] env[70520]: INFO networking_nsxv3.common.synchronization [req-9a93ce0f-035e-4040-8bda-ebd6585cb1f9 req-7a0b7f2c-df63-490a-9be7-a3d4a53aa994 service nova] Enqueued Resource ID: e2b9e825-30b0-4c46-8285-9581c34a6cc8 with Priority: HIGHEST for action port [ 1088.156949] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c90693a-14b7-438f-84ec-4b2ae33515d7 with Priority: HIGHEST for action security_group_rules [ 1088.159284] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c90693a-14b7-438f-84ec-4b2ae33515d7 with Priority: HIGHEST for action security_group_members [ 1088.159775] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2b9e825-30b0-4c46-8285-9581c34a6cc8 with Priority: HIGHEST for action port [ 1088.161984] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c90693a-14b7-438f-84ec-4b2ae33515d7 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.162302] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c90693a-14b7-438f-84ec-4b2ae33515d7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.162302] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c90693a-14b7-438f-84ec-4b2ae33515d7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.162613] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c90693a-14b7-438f-84ec-4b2ae33515d7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.163890] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c90693a-14b7-438f-84ec-4b2ae33515d7',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.165353] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c90693a-14b7-438f-84ec-4b2ae33515d7 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.165475] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c90693a-14b7-438f-84ec-4b2ae33515d7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.165576] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c90693a-14b7-438f-84ec-4b2ae33515d7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.165774] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c90693a-14b7-438f-84ec-4b2ae33515d7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.165938] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.166139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.166139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.166255] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.166334] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.166426] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c90693a-14b7-438f-84ec-4b2ae33515d7',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.167285] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2b9e825-30b0-4c46-8285-9581c34a6cc8 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.167397] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2b9e825-30b0-4c46-8285-9581c34a6cc8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.167453] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2b9e825-30b0-4c46-8285-9581c34a6cc8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.167636] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2b9e825-30b0-4c46-8285-9581c34a6cc8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.167745] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2b9e825-30b0-4c46-8285-9581c34a6cc8',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.669741] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c90693a-14b7-438f-84ec-4b2ae33515d7',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.670845] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c90693a-14b7-438f-84ec-4b2ae33515d7 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.671172] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c90693a-14b7-438f-84ec-4b2ae33515d7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.671172] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e2b9e825-30b0-4c46-8285-9581c34a6cc8 with status ACTIVE [ 1088.671364] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.671497] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.671566] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.671810] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.671945] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.672290] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.672409] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.672409] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.672672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.672751] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.673119] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.673394] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.673394] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.674065] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.674065] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.674065] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e2b9e825-30b0-4c46-8285-9581c34a6cc8 is going to be updated. [ 1088.705039] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.705204] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.705257] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.705466] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.705602] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.706097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2b9e825-30b0-4c46-8285-9581c34a6cc8" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.999448] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: SUCCESS [ 1088.999804] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.056624] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 049500dd-1e0c-481a-b7e8-f7bc25741086 in Status: SUCCESS [ 1089.056859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-049500dd-1e0c-481a-b7e8-f7bc25741086" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.057094] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-049500dd-1e0c-481a-b7e8-f7bc25741086" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.057352] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-049500dd-1e0c-481a-b7e8-f7bc25741086" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.057543] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.057687] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.057757] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.057933] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.058024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.058113] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-049500dd-1e0c-481a-b7e8-f7bc25741086" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.058203] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('049500dd-1e0c-481a-b7e8-f7bc25741086',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.176774] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c90693a-14b7-438f-84ec-4b2ae33515d7',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.560305] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('049500dd-1e0c-481a-b7e8-f7bc25741086',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.655280] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5c80f62-f996-4458-84d5-6fced2d8e47d in Status: SUCCESS [ 1089.655540] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.679209] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.679668] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.679668] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.679754] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.679833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.679945] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c90693a-14b7-438f-84ec-4b2ae33515d7 is going to be created. [ 1089.709897] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.709897] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.709897] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.710230] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.710422] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.723114] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c90693a-14b7-438f-84ec-4b2ae33515d7 in Status: UNINITIALIZED for 2s [ 1090.063133] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 049500dd-1e0c-481a-b7e8-f7bc25741086: rpc.has_security_group_logging(os_id): False [ 1090.085472] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.085472] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.085472] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.085819] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.085819] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.085942] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.086052] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.086127] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.086250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.086322] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.086415] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 049500dd-1e0c-481a-b7e8-f7bc25741086 is going to be created. [ 1090.182962] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.183138] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.183242] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.183440] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.183723] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.199545] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 049500dd-1e0c-481a-b7e8-f7bc25741086 in Status: IN_PROGRESS for 2s [ 1090.798990] env[70520]: INFO networking_nsxv3.common.synchronization [req-1cbd1c38-f94a-4e6f-9a9e-10d115939082 req-bac76c23-2b2f-466f-b84c-1d7cee6709de tempest-ServersAdminTestJSON-2063681355 tempest-ServersAdminTestJSON-2063681355-project-member] Enqueued Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_members [ 1090.799544] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 with Priority: HIGHEST for action security_group_members [ 1090.799856] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.799989] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.804035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.804035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.804194] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.804304] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.804368] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.804525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.804609] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.804700] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4e36438-996a-4d8f-adfb-5a87b2e7bd82',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.000032] env[70520]: INFO networking_nsxv3.common.synchronization [req-4a1a8df1-1fd3-4739-8c32-e53f80838558 req-051895f0-3db5-4fbb-8f63-39734a07b468 tempest-ServerActionsV293TestJSON-1078912952 tempest-ServerActionsV293TestJSON-1078912952-project-member] Enqueued Resource ID: 75f6513e-43fa-4780-ac9e-9333cfa1c6a9 with Priority: HIGHEST for action security_group_members [ 1091.001034] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75f6513e-43fa-4780-ac9e-9333cfa1c6a9 with Priority: HIGHEST for action security_group_members [ 1091.001034] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-75f6513e-43fa-4780-ac9e-9333cfa1c6a9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.001034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.001034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.001311] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.001510] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.001657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.001794] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.001983] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.002080] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.002177] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75f6513e-43fa-4780-ac9e-9333cfa1c6a9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.306826] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.306992] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.307097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.307466] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.307588] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.307912] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.308047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.308120] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.308337] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.308439] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.308532] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 is going to be updated. [ 1091.352280] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.352455] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.352497] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.352726] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.352873] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.375513] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: IN_PROGRESS for 2s [ 1091.504982] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.505185] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.505251] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.505470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.505623] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.506468] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.506652] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.506722] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.506904] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.507072] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.507339] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75f6513e-43fa-4780-ac9e-9333cfa1c6a9 already deleted. [ 1091.507452] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.529610] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-288 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.529928] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-288" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.530076] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-288" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.530455] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-288" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.531597] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.531859] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.531988] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.532253] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.532400] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.532613] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1091.532738] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1091.532867] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1091.533024] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1091.533162] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1091.533273] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1091.533413] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1091.561037] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1091.561037] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1091.561037] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1091.561300] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-288" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.562023] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-78d43ac4-17a5-4fdd-b196-70ab4500ca01 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.562023] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-78d43ac4-17a5-4fdd-b196-70ab4500ca01" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.562023] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-78d43ac4-17a5-4fdd-b196-70ab4500ca01" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.562291] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-78d43ac4-17a5-4fdd-b196-70ab4500ca01" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.562393] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78d43ac4-17a5-4fdd-b196-70ab4500ca01',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.736616] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c90693a-14b7-438f-84ec-4b2ae33515d7 in Status: SUCCESS [ 1091.736616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c90693a-14b7-438f-84ec-4b2ae33515d7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.736616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c90693a-14b7-438f-84ec-4b2ae33515d7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.736616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c90693a-14b7-438f-84ec-4b2ae33515d7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.736616] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.736939] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.736939] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.737052] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.737108] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.737353] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c90693a-14b7-438f-84ec-4b2ae33515d7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.737353] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c90693a-14b7-438f-84ec-4b2ae33515d7',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.065145] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.065600] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.065600] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.065785] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.066053] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.066164] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 78d43ac4-17a5-4fdd-b196-70ab4500ca01 not found, creating... [ 1092.066370] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.066531] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.066648] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.066871] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.067313] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.067313] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.067465] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.067712] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.067798] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.067938] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.068094] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 78d43ac4-17a5-4fdd-b196-70ab4500ca01 is going to be created. [ 1092.099574] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.099875] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.100036] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.100304] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.100569] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.100896] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-78d43ac4-17a5-4fdd-b196-70ab4500ca01" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.217232] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 049500dd-1e0c-481a-b7e8-f7bc25741086 in Status: SUCCESS [ 1092.217488] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-049500dd-1e0c-481a-b7e8-f7bc25741086" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.240092] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c90693a-14b7-438f-84ec-4b2ae33515d7',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.584517] env[70520]: INFO networking_nsxv3.common.synchronization [req-494e5887-6de9-4f3c-9f01-c2b969d5cb98 req-e1c1555e-7375-4c94-aebe-92475975c92c tempest-ServerRescueTestJSON-1210437654 tempest-ServerRescueTestJSON-1210437654-project-member] Enqueued Resource ID: 58550c6c-a09f-469c-981b-0404b38bdf5d with Priority: HIGHEST for action security_group_members [ 1092.585068] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58550c6c-a09f-469c-981b-0404b38bdf5d with Priority: HIGHEST for action security_group_members [ 1092.585421] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-58550c6c-a09f-469c-981b-0404b38bdf5d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.586064] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.586064] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.586064] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.586064] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.586575] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.586642] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.586809] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.586895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.587018] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58550c6c-a09f-469c-981b-0404b38bdf5d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.743019] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c90693a-14b7-438f-84ec-4b2ae33515d7: rpc.has_security_group_logging(os_id): False [ 1092.766034] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.766034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.766034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.766034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.766034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.766034] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.766034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.766034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.766034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.770032] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.770032] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c90693a-14b7-438f-84ec-4b2ae33515d7 is going to be created. [ 1092.845035] env[70520]: INFO networking_nsxv3.common.synchronization [req-a46ab379-b11c-4cf5-b8e3-7cbd45d6fbbc req-92a6a3ff-2772-41b8-9914-573951a819d6 tempest-ServersTestJSON-589199853 tempest-ServersTestJSON-589199853-project-member] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1092.845035] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1092.845757] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.846237] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.846541] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.846878] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.849096] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.849096] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.849096] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.849096] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.849096] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.849096] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.854172] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.854172] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.854172] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.855150] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.855544] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.870314] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c90693a-14b7-438f-84ec-4b2ae33515d7 in Status: IN_PROGRESS for 2s [ 1092.950382] env[70520]: INFO networking_nsxv3.common.synchronization [req-4a1a8df1-1fd3-4739-8c32-e53f80838558 req-a55024ea-6629-41c0-a6b8-d6b045d9083f service nova] Enqueued Resource ID: 75f6513e-43fa-4780-ac9e-9333cfa1c6a9 with Priority: HIGHEST for action security_group_rules [ 1092.950382] env[70520]: INFO networking_nsxv3.common.synchronization [req-4a1a8df1-1fd3-4739-8c32-e53f80838558 req-a55024ea-6629-41c0-a6b8-d6b045d9083f service nova] Enqueued Resource ID: 75f6513e-43fa-4780-ac9e-9333cfa1c6a9 with Priority: HIGHEST for action security_group_members [ 1092.950382] env[70520]: INFO networking_nsxv3.common.synchronization [req-4a1a8df1-1fd3-4739-8c32-e53f80838558 req-a55024ea-6629-41c0-a6b8-d6b045d9083f service nova] Enqueued Resource ID: 78d43ac4-17a5-4fdd-b196-70ab4500ca01 with Priority: HIGHEST for action port [ 1092.950382] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75f6513e-43fa-4780-ac9e-9333cfa1c6a9 with Priority: HIGHEST for action security_group_rules [ 1092.950382] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75f6513e-43fa-4780-ac9e-9333cfa1c6a9 with Priority: HIGHEST for action security_group_members [ 1092.950382] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78d43ac4-17a5-4fdd-b196-70ab4500ca01 with Priority: HIGHEST for action port [ 1092.953162] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75f6513e-43fa-4780-ac9e-9333cfa1c6a9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.953343] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.953506] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.953810] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.953955] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75f6513e-43fa-4780-ac9e-9333cfa1c6a9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.955143] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-75f6513e-43fa-4780-ac9e-9333cfa1c6a9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.955285] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.955365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.955655] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.955864] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.956016] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.956132] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.956370] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.956508] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.956609] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75f6513e-43fa-4780-ac9e-9333cfa1c6a9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.957730] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-78d43ac4-17a5-4fdd-b196-70ab4500ca01 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.957867] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78d43ac4-17a5-4fdd-b196-70ab4500ca01" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.957929] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78d43ac4-17a5-4fdd-b196-70ab4500ca01" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.958214] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78d43ac4-17a5-4fdd-b196-70ab4500ca01" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.958365] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78d43ac4-17a5-4fdd-b196-70ab4500ca01',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.089110] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58550c6c-a09f-469c-981b-0404b38bdf5d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.358881] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.387214] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 in Status: SUCCESS [ 1093.387214] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4e36438-996a-4d8f-adfb-5a87b2e7bd82 deletion is rescheduled due to dependency. [ 1093.387214] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4e36438-996a-4d8f-adfb-5a87b2e7bd82" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.461921] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-75f6513e-43fa-4780-ac9e-9333cfa1c6a9 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.461921] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.461921] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75f6513e-43fa-4780-ac9e-9333cfa1c6a9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.470019] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 78d43ac4-17a5-4fdd-b196-70ab4500ca01 with status ACTIVE [ 1093.470019] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.470019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.470019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.470019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.470019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.470019] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.470019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.470019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.470019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.470019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.470019] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.470019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.470019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.470019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.470019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.470019] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 78d43ac4-17a5-4fdd-b196-70ab4500ca01 is going to be updated. [ 1093.490083] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.490083] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.490083] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.490083] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.490083] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.490930] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78d43ac4-17a5-4fdd-b196-70ab4500ca01" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.592487] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58550c6c-a09f-469c-981b-0404b38bdf5d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.861891] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.967537] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75f6513e-43fa-4780-ac9e-9333cfa1c6a9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.098522] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.098875] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.098875] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.098989] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.099134] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.099181] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58550c6c-a09f-469c-981b-0404b38bdf5d is going to be updated. [ 1094.138287] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.138426] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.138504] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.138727] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.138868] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.148547] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58550c6c-a09f-469c-981b-0404b38bdf5d in Status: IN_PROGRESS for 2s [ 1094.364578] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.364723] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.364807] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.365072] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.365170] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.365270] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be updated. [ 1094.398255] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.398413] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.398476] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.398672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.398815] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.408531] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: IN_PROGRESS for 2s [ 1094.471251] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.471459] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.471509] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.471734] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.471924] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.471924] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75f6513e-43fa-4780-ac9e-9333cfa1c6a9 is going to be created. [ 1094.504478] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.504631] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.504706] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.505109] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.505325] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.519202] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75f6513e-43fa-4780-ac9e-9333cfa1c6a9 in Status: UNINITIALIZED for 2s [ 1094.883895] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c90693a-14b7-438f-84ec-4b2ae33515d7 in Status: SUCCESS [ 1094.883895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c90693a-14b7-438f-84ec-4b2ae33515d7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.919834] env[70520]: INFO networking_nsxv3.common.synchronization [req-9c3b89e4-e576-4094-b904-5c9f01da4c21 req-78ab7953-5a4b-4cad-8a00-9b200bd171e9 tempest-ServerAddressesNegativeTestJSON-920979130 tempest-ServerAddressesNegativeTestJSON-920979130-project-member] Enqueued Resource ID: c5c80f62-f996-4458-84d5-6fced2d8e47d with Priority: HIGHEST for action security_group_members [ 1094.919834] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c80f62-f996-4458-84d5-6fced2d8e47d with Priority: HIGHEST for action security_group_members [ 1094.919834] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c80f62-f996-4458-84d5-6fced2d8e47d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.919834] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.920900] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.921249] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.921545] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.922164] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.922339] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.926557] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.926860] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.927127] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c80f62-f996-4458-84d5-6fced2d8e47d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.434034] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.434034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.434034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.434034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.434034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.434034] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.434034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.434034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.434034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.434034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.434034] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c80f62-f996-4458-84d5-6fced2d8e47d is going to be updated. [ 1095.463205] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.463205] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.463205] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.463205] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.463205] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.473934] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c80f62-f996-4458-84d5-6fced2d8e47d in Status: IN_PROGRESS for 2s [ 1096.161206] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58550c6c-a09f-469c-981b-0404b38bdf5d in Status: SUCCESS [ 1096.161206] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.420702] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: SUCCESS [ 1096.421288] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.489279] env[70520]: INFO networking_nsxv3.common.synchronization [req-9dd354ad-7453-4e24-acff-39f0919a7d77 req-917b777d-99c8-4cb2-a6d9-b6aaf4123432 tempest-ServerDiskConfigTestJSON-984450191 tempest-ServerDiskConfigTestJSON-984450191-project-member] Enqueued Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 1096.490314] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 1096.490552] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.490809] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.490902] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.491191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.491374] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.491873] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.491873] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.491873] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.492023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.492117] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.529471] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75f6513e-43fa-4780-ac9e-9333cfa1c6a9 in Status: SUCCESS [ 1096.529773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.530467] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.530762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.531192] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.531389] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.531506] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.531733] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.531853] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.531976] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.532152] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75f6513e-43fa-4780-ac9e-9333cfa1c6a9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.997073] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.997073] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.997419] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.997419] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.997419] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.997626] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.997819] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.997947] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.998163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.998253] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.998343] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 is going to be updated. [ 1097.031581] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.031937] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.031937] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.032185] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.032185] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.034268] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75f6513e-43fa-4780-ac9e-9333cfa1c6a9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.046411] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: IN_PROGRESS for 2s [ 1097.486998] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c80f62-f996-4458-84d5-6fced2d8e47d in Status: SUCCESS [ 1097.487289] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c80f62-f996-4458-84d5-6fced2d8e47d deletion is rescheduled due to dependency. [ 1097.487379] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.539708] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75f6513e-43fa-4780-ac9e-9333cfa1c6a9: rpc.has_security_group_logging(os_id): False [ 1097.563042] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.563042] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.563042] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.563042] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.563336] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.564038] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.564038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.564038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.564251] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.564251] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.564338] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75f6513e-43fa-4780-ac9e-9333cfa1c6a9 is going to be created. [ 1097.650074] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.650074] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.650074] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.650074] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.650074] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.666515] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75f6513e-43fa-4780-ac9e-9333cfa1c6a9 in Status: IN_PROGRESS for 2s [ 1097.939640] env[70520]: INFO networking_nsxv3.common.synchronization [req-0c2794a7-f61f-41a1-af7e-218e04790da6 req-fb5a7013-e815-43be-9cbf-122733ddc326 tempest-ServersTestMultiNic-541139820 tempest-ServersTestMultiNic-541139820-project-member] Enqueued Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1097.940270] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1097.940595] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.940718] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.940783] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.940973] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.941141] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.941235] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.941300] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.941449] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.941539] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.941640] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.319600] env[70520]: INFO networking_nsxv3.common.synchronization [req-0c2794a7-f61f-41a1-af7e-218e04790da6 req-26b3d0ef-2839-4069-bc62-86f18a9e380e tempest-ServersTestMultiNic-541139820 tempest-ServersTestMultiNic-541139820-project-member] Enqueued Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1098.319600] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1098.324038] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.324038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.443523] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.443706] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.443749] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.444523] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.444523] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.444523] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.444523] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.444523] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.444793] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.444793] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.444793] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a238fd65-d476-4f25-8c29-5e2babcc5026 is going to be updated. [ 1098.478082] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.478323] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.478323] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.478564] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.478683] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.493660] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: IN_PROGRESS for 2s [ 1098.693338] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-648 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.693781] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-648" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.693781] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-648" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.694017] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-648" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.694288] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.694453] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.694582] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.698131] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.698131] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.698131] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1098.698131] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1098.698131] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1098.698131] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1098.698131] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1098.698131] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1098.698131] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1098.732156] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1098.732380] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1098.732482] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1098.732660] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-648" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.733941] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-3ab5b493-dc80-47dc-b0c9-7c5f69fb22a3 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.734179] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-3ab5b493-dc80-47dc-b0c9-7c5f69fb22a3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.734305] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-3ab5b493-dc80-47dc-b0c9-7c5f69fb22a3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.734679] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-3ab5b493-dc80-47dc-b0c9-7c5f69fb22a3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.734830] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ab5b493-dc80-47dc-b0c9-7c5f69fb22a3',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.056620] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: SUCCESS [ 1099.056825] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 deletion is rescheduled due to dependency. [ 1099.056957] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.238857] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.239222] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.239401] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.239576] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.239725] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.239884] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 3ab5b493-dc80-47dc-b0c9-7c5f69fb22a3 not found, creating... [ 1099.240191] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.240402] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.240587] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.240696] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.240839] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.241164] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.241451] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.241636] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.241803] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.241947] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.242075] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 3ab5b493-dc80-47dc-b0c9-7c5f69fb22a3 is going to be created. [ 1099.267018] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.267287] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.267468] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.267878] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.268265] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.268440] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-3ab5b493-dc80-47dc-b0c9-7c5f69fb22a3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.683947] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75f6513e-43fa-4780-ac9e-9333cfa1c6a9 in Status: SUCCESS [ 1099.683947] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.960547] env[70520]: INFO networking_nsxv3.common.synchronization [req-0c2794a7-f61f-41a1-af7e-218e04790da6 req-88c3d359-afa2-4a27-9db3-1991a97d00d9 service nova] Enqueued Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_rules [ 1099.960825] env[70520]: INFO networking_nsxv3.common.synchronization [req-0c2794a7-f61f-41a1-af7e-218e04790da6 req-88c3d359-afa2-4a27-9db3-1991a97d00d9 service nova] Enqueued Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1099.960901] env[70520]: INFO networking_nsxv3.common.synchronization [req-0c2794a7-f61f-41a1-af7e-218e04790da6 req-88c3d359-afa2-4a27-9db3-1991a97d00d9 service nova] Enqueued Resource ID: 3ab5b493-dc80-47dc-b0c9-7c5f69fb22a3 with Priority: HIGHEST for action port [ 1099.964382] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_rules [ 1099.964382] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1099.964382] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ab5b493-dc80-47dc-b0c9-7c5f69fb22a3 with Priority: HIGHEST for action port [ 1099.964382] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.964382] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.964382] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.964382] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.964382] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.964382] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.964382] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.964382] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ab5b493-dc80-47dc-b0c9-7c5f69fb22a3 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.964382] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ab5b493-dc80-47dc-b0c9-7c5f69fb22a3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.964382] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ab5b493-dc80-47dc-b0c9-7c5f69fb22a3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.965066] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ab5b493-dc80-47dc-b0c9-7c5f69fb22a3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.965066] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ab5b493-dc80-47dc-b0c9-7c5f69fb22a3',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.466720] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.466845] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.467049] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ab5b493-dc80-47dc-b0c9-7c5f69fb22a3 with status ACTIVE [ 1100.467250] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.467398] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.467474] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.467678] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.467769] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.468065] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.468126] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.468201] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.468350] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.468456] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.468626] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.468745] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.468864] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.469029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.469100] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.469187] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ab5b493-dc80-47dc-b0c9-7c5f69fb22a3 is going to be updated. [ 1100.491233] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.491484] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.491584] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.491934] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.492038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.492136] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ab5b493-dc80-47dc-b0c9-7c5f69fb22a3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.504325] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: SUCCESS [ 1100.504541] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a238fd65-d476-4f25-8c29-5e2babcc5026 deletion is rescheduled due to dependency. [ 1100.504659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.504817] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.505037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.505220] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.505335] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.505416] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.505590] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.505699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.505834] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.808101] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-762 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.808366] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-762" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.808477] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-762" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.808823] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-762" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.809179] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.809387] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.809467] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.809704] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.809870] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.810104] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1100.810213] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1100.810322] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1100.810430] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1100.810536] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1100.810641] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1100.810774] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1100.829855] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1100.830026] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1100.830247] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1100.830674] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-762" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.830806] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-5805ea47-0066-48cc-82c3-af78bfa2dfb2 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.830976] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-5805ea47-0066-48cc-82c3-af78bfa2dfb2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.831104] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-5805ea47-0066-48cc-82c3-af78bfa2dfb2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.831442] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-5805ea47-0066-48cc-82c3-af78bfa2dfb2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.831587] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5805ea47-0066-48cc-82c3-af78bfa2dfb2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.009298] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.334676] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.334676] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.334676] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.334676] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.334986] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.335104] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 5805ea47-0066-48cc-82c3-af78bfa2dfb2 not found, creating... [ 1101.335423] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.335614] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.335870] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.336195] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.336359] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.336776] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.336965] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.337121] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.337387] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.337612] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.337786] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 5805ea47-0066-48cc-82c3-af78bfa2dfb2 is going to be created. [ 1101.360550] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.360880] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.360880] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.361377] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.361641] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.361875] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-5805ea47-0066-48cc-82c3-af78bfa2dfb2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.512605] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.015071] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.015504] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.015504] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.015504] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.015691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.015691] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a238fd65-d476-4f25-8c29-5e2babcc5026 is going to be updated. [ 1102.075661] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.075888] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.076294] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.076294] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.076294] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.089085] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: IN_PROGRESS for 2s [ 1102.398628] env[70520]: INFO networking_nsxv3.common.synchronization [req-0c2794a7-f61f-41a1-af7e-218e04790da6 req-27ce2714-82e2-49b6-8f33-d246b8231ba8 service nova] Enqueued Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_rules [ 1102.398846] env[70520]: INFO networking_nsxv3.common.synchronization [req-0c2794a7-f61f-41a1-af7e-218e04790da6 req-27ce2714-82e2-49b6-8f33-d246b8231ba8 service nova] Enqueued Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1102.398965] env[70520]: INFO networking_nsxv3.common.synchronization [req-0c2794a7-f61f-41a1-af7e-218e04790da6 req-27ce2714-82e2-49b6-8f33-d246b8231ba8 service nova] Enqueued Resource ID: 5805ea47-0066-48cc-82c3-af78bfa2dfb2 with Priority: HIGHEST for action port [ 1102.399500] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_rules [ 1102.399634] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1102.399732] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5805ea47-0066-48cc-82c3-af78bfa2dfb2 with Priority: HIGHEST for action port [ 1102.400019] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.400564] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.401083] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.401083] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.401302] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-5805ea47-0066-48cc-82c3-af78bfa2dfb2 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.401302] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5805ea47-0066-48cc-82c3-af78bfa2dfb2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.401302] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5805ea47-0066-48cc-82c3-af78bfa2dfb2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.401698] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5805ea47-0066-48cc-82c3-af78bfa2dfb2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.401801] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5805ea47-0066-48cc-82c3-af78bfa2dfb2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.904991] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5805ea47-0066-48cc-82c3-af78bfa2dfb2 with status ACTIVE [ 1102.905262] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.905404] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.905468] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.905678] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.905810] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.906226] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.906226] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.906361] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.906516] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.906600] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.906785] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.906873] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.906941] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.907095] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.907165] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.907254] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5805ea47-0066-48cc-82c3-af78bfa2dfb2 is going to be updated. [ 1102.933724] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.933901] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.933983] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.934228] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.934373] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.934551] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5805ea47-0066-48cc-82c3-af78bfa2dfb2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.104611] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: SUCCESS [ 1104.104611] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.104611] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.104611] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.104611] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.104611] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.104611] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.104611] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.104611] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.104611] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.609310] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.115411] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.622193] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.622364] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.622437] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.622663] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.622753] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.622850] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a238fd65-d476-4f25-8c29-5e2babcc5026 is going to be updated. [ 1105.653490] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.653638] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.653700] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.656019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.656019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.668933] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: IN_PROGRESS for 2s [ 1105.954267] env[70520]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1105.954267] env[70520]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] NSXv3 Agent Agent loop - iteration:2 started [ 1106.394305] env[70520]: INFO networking_nsxv3.common.synchronization [req-206bae9b-a660-4759-8000-f79e21d5e44a req-a57a7c2e-935f-4242-985e-0a0be76c6181 tempest-ImagesTestJSON-1211196503 tempest-ImagesTestJSON-1211196503-project-member] Enqueued Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1106.395559] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1106.396456] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.400208] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.400298] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.400515] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.400715] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.400833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.400918] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.401415] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.401415] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.401415] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.904501] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.904694] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.904734] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.904954] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.905084] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.905289] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.905389] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.905451] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.905605] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.905682] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.905769] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 is going to be updated. [ 1106.937926] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.938120] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.938200] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.938493] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.938662] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.952152] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: IN_PROGRESS for 2s [ 1107.567935] env[70520]: INFO networking_nsxv3.common.synchronization [req-324cecc8-99b7-4b46-a3fe-c9d8981ed8a7 req-5a2cb565-03af-4e05-9035-da1217d61e3f tempest-ServerRescueTestJSON-1210437654 tempest-ServerRescueTestJSON-1210437654-project-member] Enqueued Resource ID: 58550c6c-a09f-469c-981b-0404b38bdf5d with Priority: HIGHEST for action security_group_members [ 1107.568484] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58550c6c-a09f-469c-981b-0404b38bdf5d with Priority: HIGHEST for action security_group_members [ 1107.568785] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-58550c6c-a09f-469c-981b-0404b38bdf5d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.568903] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.568962] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.569173] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.569317] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.572226] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.572226] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.572226] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.572226] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.572226] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58550c6c-a09f-469c-981b-0404b38bdf5d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.590022] env[70520]: INFO networking_nsxv3.common.synchronization [req-95a54f27-eaa3-4552-9e39-83fd13c2eb90 req-e077171b-ab15-408c-a74e-dabe2e4cdb18 tempest-ServerDiskConfigTestJSON-984450191 tempest-ServerDiskConfigTestJSON-984450191-project-member] Enqueued Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 1107.590535] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 1107.590844] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.590964] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.592302] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.592302] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.592976] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.593231] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.593319] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.593524] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.593615] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.593728] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.681300] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: SUCCESS [ 1107.681526] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.681694] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.681907] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.682117] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.682235] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.682293] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.682442] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.682518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.682637] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.683124] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.683742] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.683742] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.685105] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.685172] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.685207] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.685350] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.685430] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.685519] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.025737] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-265 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.025942] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-265" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.026074] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-265" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.026354] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-265" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.027821] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.027821] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.027821] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.027821] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.027821] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.028626] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1108.028626] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1108.028626] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1108.028626] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1108.028626] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1108.028626] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1108.028626] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1108.056177] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1108.056177] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1108.056177] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1108.056177] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-265" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.057272] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-4fc06fde-e8fa-462b-b802-850c9c8d6438 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.057506] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-4fc06fde-e8fa-462b-b802-850c9c8d6438" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.057675] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-4fc06fde-e8fa-462b-b802-850c9c8d6438" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.058089] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-4fc06fde-e8fa-462b-b802-850c9c8d6438" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.058267] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fc06fde-e8fa-462b-b802-850c9c8d6438',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.074147] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.074308] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.074448] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.074610] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.074697] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.074911] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.075022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.075086] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.075266] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.075299] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.078812] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58550c6c-a09f-469c-981b-0404b38bdf5d is going to be updated. [ 1108.100085] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.100085] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.100334] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.103555] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.103555] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.103555] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.103555] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.103555] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.103555] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.103555] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.103555] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 is going to be updated. [ 1108.121843] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.121999] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.122079] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.122288] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.122430] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.133244] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58550c6c-a09f-469c-981b-0404b38bdf5d in Status: IN_PROGRESS for 2s [ 1108.137709] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.137845] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.137967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.138214] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.138357] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.159525] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: IN_PROGRESS for 2s [ 1108.188710] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.188710] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.188847] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.561251] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.561441] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.561569] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.561860] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.562028] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.562190] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 4fc06fde-e8fa-462b-b802-850c9c8d6438 not found, creating... [ 1108.562553] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.562713] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.562834] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.563090] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.563241] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.563530] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.563691] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.563812] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.564264] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.564450] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.564600] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 4fc06fde-e8fa-462b-b802-850c9c8d6438 is going to be created. [ 1108.585609] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.586039] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.586039] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.586275] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.586585] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.586867] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-4fc06fde-e8fa-462b-b802-850c9c8d6438" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.692253] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.960997] env[70520]: INFO networking_nsxv3.common.synchronization [req-9bccd060-cfa1-4ed9-8e31-9deadc136a2f req-2323f740-908e-4bf0-8610-5ae09cf2d568 tempest-AttachVolumeNegativeTest-1224878754 tempest-AttachVolumeNegativeTest-1224878754-project-member] Enqueued Resource ID: 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f with Priority: HIGHEST for action security_group_members [ 1108.963048] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: SUCCESS [ 1108.963347] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 deletion is rescheduled due to dependency. [ 1108.966778] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.966778] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f with Priority: HIGHEST for action security_group_members [ 1108.966778] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.966778] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.966778] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.966778] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.966778] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.966778] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.966778] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.966778] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.966778] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.966778] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8af5cf3c-e464-4241-82ec-9fc46dc5ae9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.196449] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.196449] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.196449] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.196449] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.196590] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.196665] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a238fd65-d476-4f25-8c29-5e2babcc5026 is going to be updated. [ 1109.234168] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.234418] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.235064] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.235565] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.235900] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.246549] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: IN_PROGRESS for 2s [ 1109.470973] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.471158] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.471266] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.471447] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.492822] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.493100] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.493220] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.493285] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.493488] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.493568] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.493658] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f is going to be updated. [ 1109.523292] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.523292] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.523292] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.523498] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.523524] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.534210] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f in Status: IN_PROGRESS for 2s [ 1109.639758] env[70520]: INFO networking_nsxv3.common.synchronization [req-95a54f27-eaa3-4552-9e39-83fd13c2eb90 req-366fc30c-3c0f-42e2-914b-dd1d7a2441b6 service nova] Enqueued Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_rules [ 1109.640028] env[70520]: INFO networking_nsxv3.common.synchronization [req-95a54f27-eaa3-4552-9e39-83fd13c2eb90 req-366fc30c-3c0f-42e2-914b-dd1d7a2441b6 service nova] Enqueued Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 1109.640086] env[70520]: INFO networking_nsxv3.common.synchronization [req-95a54f27-eaa3-4552-9e39-83fd13c2eb90 req-366fc30c-3c0f-42e2-914b-dd1d7a2441b6 service nova] Enqueued Resource ID: 4fc06fde-e8fa-462b-b802-850c9c8d6438 with Priority: HIGHEST for action port [ 1109.640585] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_rules [ 1109.640717] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 1109.640812] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fc06fde-e8fa-462b-b802-850c9c8d6438 with Priority: HIGHEST for action port [ 1109.641110] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.641234] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.641300] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.641500] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.641580] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.643080] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.643238] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.643392] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-4fc06fde-e8fa-462b-b802-850c9c8d6438 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.643485] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4fc06fde-e8fa-462b-b802-850c9c8d6438" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.643550] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4fc06fde-e8fa-462b-b802-850c9c8d6438" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.643770] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4fc06fde-e8fa-462b-b802-850c9c8d6438" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.643849] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fc06fde-e8fa-462b-b802-850c9c8d6438',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.145189] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58550c6c-a09f-469c-981b-0404b38bdf5d in Status: SUCCESS [ 1110.145397] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58550c6c-a09f-469c-981b-0404b38bdf5d deletion is rescheduled due to dependency. [ 1110.145761] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.146067] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.146145] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.150273] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4fc06fde-e8fa-462b-b802-850c9c8d6438 with status ACTIVE [ 1110.150273] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.150273] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.150273] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.150273] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.150273] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.150273] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.150273] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.150273] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.150273] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.150273] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.150603] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.150603] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.150603] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.150787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.151077] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.151077] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4fc06fde-e8fa-462b-b802-850c9c8d6438 is going to be updated. [ 1110.175507] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: SUCCESS [ 1110.175693] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 deletion is rescheduled due to dependency. [ 1110.175806] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.176342] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.176342] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.176477] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.176963] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.176963] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.176963] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.176963] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.177141] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.200360] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.200556] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.200632] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.200919] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.201148] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.201358] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4fc06fde-e8fa-462b-b802-850c9c8d6438" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.660566] env[70520]: INFO networking_nsxv3.common.synchronization [req-acc134e7-f526-498e-8fa0-ac3165c879cc req-fb56dffb-b76e-4683-93fa-e75af4157fcf tempest-DeleteServersTestJSON-1399047283 tempest-DeleteServersTestJSON-1399047283-project-member] Enqueued Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 1110.660890] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 1110.661083] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.661236] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.661334] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.661559] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.661761] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.662341] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.667423] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.667423] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.667423] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.667423] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.680523] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.118909] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-493 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.119171] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-493" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.119330] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-493" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.119651] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-493" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.119988] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.122760] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.123190] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.123482] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.124703] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.124993] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1111.125151] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1111.125270] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1111.125385] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1111.125536] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1111.126822] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1111.127094] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1111.148183] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1111.148463] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1111.148615] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1111.148804] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-493" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.149170] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-7c4b3e40-2dba-4d8e-b97b-e21cbc12408a taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.149352] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-7c4b3e40-2dba-4d8e-b97b-e21cbc12408a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.149472] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-7c4b3e40-2dba-4d8e-b97b-e21cbc12408a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.149819] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-7c4b3e40-2dba-4d8e-b97b-e21cbc12408a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.149964] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c4b3e40-2dba-4d8e-b97b-e21cbc12408a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.168767] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.169049] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.169049] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.169410] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.169978] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.169978] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.170122] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.170122] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.170634] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.170634] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.170634] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f is going to be updated. [ 1111.183926] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.201195] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.201485] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.201612] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.201873] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.202273] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.218224] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: IN_PROGRESS for 2s [ 1111.272027] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: SUCCESS [ 1111.272027] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.272027] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.272027] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.272027] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.272027] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.272027] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.272748] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.273048] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.273314] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.273693] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.273990] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.274222] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.274546] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.274881] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.275591] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.275591] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.275591] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.275750] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.275811] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.275970] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.545076] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f in Status: SUCCESS [ 1111.545338] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f deletion is rescheduled due to dependency. [ 1111.545494] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.653138] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.653138] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.653138] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.653138] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.653138] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.653138] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 7c4b3e40-2dba-4d8e-b97b-e21cbc12408a not found, creating... [ 1111.653420] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.653671] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.653671] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.654389] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.654389] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.654512] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.654823] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.654823] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.655053] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.655224] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.655396] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 7c4b3e40-2dba-4d8e-b97b-e21cbc12408a is going to be created. [ 1111.680896] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.681363] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.681526] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.681915] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.682292] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.682672] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-7c4b3e40-2dba-4d8e-b97b-e21cbc12408a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.688655] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.688840] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.688989] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.689260] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.689400] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.689549] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 is going to be updated. [ 1111.732512] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.732682] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.732757] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.732989] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.733163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.743522] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: IN_PROGRESS for 2s [ 1111.779515] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a238fd65-d476-4f25-8c29-5e2babcc5026: rpc.has_security_group_logging(os_id): False [ 1111.799993] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.800162] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.800228] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.800443] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.800528] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.800723] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.800818] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.800876] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.801906] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.801906] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.801906] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.801906] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.801906] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.801906] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.801906] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.801906] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.801906] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.802354] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.802354] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.802354] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.802444] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a238fd65-d476-4f25-8c29-5e2babcc5026 is going to be updated. [ 1111.884901] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.885079] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.885150] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.885357] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.885501] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.900158] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: IN_PROGRESS for 2s [ 1112.693942] env[70520]: INFO networking_nsxv3.common.synchronization [req-acc134e7-f526-498e-8fa0-ac3165c879cc req-b178bfc5-da8a-4c8d-a4a1-a5062af2bb3a service nova] Enqueued Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_rules [ 1112.693942] env[70520]: INFO networking_nsxv3.common.synchronization [req-acc134e7-f526-498e-8fa0-ac3165c879cc req-b178bfc5-da8a-4c8d-a4a1-a5062af2bb3a service nova] Enqueued Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 1112.693942] env[70520]: INFO networking_nsxv3.common.synchronization [req-acc134e7-f526-498e-8fa0-ac3165c879cc req-b178bfc5-da8a-4c8d-a4a1-a5062af2bb3a service nova] Enqueued Resource ID: 7c4b3e40-2dba-4d8e-b97b-e21cbc12408a with Priority: HIGHEST for action port [ 1112.694449] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_rules [ 1112.694571] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 1112.694804] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c4b3e40-2dba-4d8e-b97b-e21cbc12408a with Priority: HIGHEST for action port [ 1112.695291] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.695417] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.695502] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.696307] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.696683] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.697603] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.697715] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.697909] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c4b3e40-2dba-4d8e-b97b-e21cbc12408a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.698351] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c4b3e40-2dba-4d8e-b97b-e21cbc12408a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.698424] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c4b3e40-2dba-4d8e-b97b-e21cbc12408a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.698628] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c4b3e40-2dba-4d8e-b97b-e21cbc12408a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.698716] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c4b3e40-2dba-4d8e-b97b-e21cbc12408a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.151240] env[70520]: INFO networking_nsxv3.common.synchronization [None req-6e4ee723-143d-4370-82ef-e722c76ae1e8 None None] Enqueued Resource ID: e9deee15-47ac-425f-8477-f5531b47e15f with Priority: HIGHEST for action port [ 1113.151489] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9deee15-47ac-425f-8477-f5531b47e15f with Priority: HIGHEST for action port [ 1113.152080] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9deee15-47ac-425f-8477-f5531b47e15f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.152221] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9deee15-47ac-425f-8477-f5531b47e15f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.152418] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9deee15-47ac-425f-8477-f5531b47e15f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.152986] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9deee15-47ac-425f-8477-f5531b47e15f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.153088] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9deee15-47ac-425f-8477-f5531b47e15f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.201422] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.201691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.201953] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c4b3e40-2dba-4d8e-b97b-e21cbc12408a with status ACTIVE [ 1113.201953] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.202113] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.202113] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.202313] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.202403] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.202596] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.202693] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.202763] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.202926] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.203019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.203237] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.203343] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.203407] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.203556] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.203640] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.203723] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c4b3e40-2dba-4d8e-b97b-e21cbc12408a is going to be updated. [ 1113.229103] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: SUCCESS [ 1113.229337] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f deletion is rescheduled due to dependency. [ 1113.229402] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.230471] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.230471] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.230471] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.230471] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.230471] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.230471] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.230721] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.230721] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.240441] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.240692] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.240692] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.240978] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.241155] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.242059] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c4b3e40-2dba-4d8e-b97b-e21cbc12408a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.655406] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e9deee15-47ac-425f-8477-f5531b47e15f [ 1113.655645] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.656282] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.656282] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.656282] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.656282] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.656282] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e9deee15-47ac-425f-8477-f5531b47e15f already deleted. [ 1113.656470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9deee15-47ac-425f-8477-f5531b47e15f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.740015] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.753875] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: SUCCESS [ 1113.754061] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.754967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.754967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.754967] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.754967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.755297] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.755574] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.755679] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.755800] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.755900] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.918266] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: SUCCESS [ 1113.918405] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.918564] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.918788] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.918883] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.241611] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.259467] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.259609] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.259679] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.259895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.260072] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.260176] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.260239] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.260401] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.260483] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.260571] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.260712] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.260803] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.260862] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.261013] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.261157] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.261250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.261310] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.261443] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.261516] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.261598] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.261681] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.421171] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.421332] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.421410] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.421672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.421872] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.422029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.422124] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.422304] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.422416] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.422526] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.422634] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.570351] env[70520]: INFO networking_nsxv3.common.synchronization [req-0ec91a85-28d3-43d6-a743-098d5931dd40 req-ce5ab502-bc12-4c10-a545-744dd8d36e9d tempest-ImagesTestJSON-1211196503 tempest-ImagesTestJSON-1211196503-project-member] Enqueued Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1114.570875] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1114.571193] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.571315] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.571379] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.571588] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.571737] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.571849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.571910] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.576168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.576285] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.576386] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.746408] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.746408] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.746408] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.746408] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.746408] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.746408] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f is going to be updated. [ 1114.768369] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a23aa860-12db-4b07-ac46-cf4709db7164: rpc.has_security_group_logging(os_id): False [ 1114.778521] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.778674] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.778812] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.778951] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.779173] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.791540] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.792368] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.792368] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.792368] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.792368] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.792368] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.792612] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.792612] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.792612] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.792717] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.792909] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.792994] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.792994] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.793217] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.793310] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.793419] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.793851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.793851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.793851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.793851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.793851] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 is going to be updated. [ 1114.795690] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: IN_PROGRESS for 2s [ 1114.868969] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.869303] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.869303] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.869491] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.869546] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.891305] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: IN_PROGRESS for 2s [ 1114.928092] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.928487] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.928487] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.928807] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.928942] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.929357] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.929357] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.929524] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.929524] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.929641] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.929911] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.929911] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.930047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.930294] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.930294] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.930412] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.930412] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.930529] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.930600] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.930684] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.930811] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.078800] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.080094] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.080094] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.080094] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.080094] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.080094] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.080094] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.080094] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.080094] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.080094] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.080094] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 is going to be updated. [ 1115.115023] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.115023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.115023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.115023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.115023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.126252] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: IN_PROGRESS for 2s [ 1115.166938] env[70520]: INFO networking_nsxv3.common.synchronization [req-ecc1daa8-19ac-492b-ad18-7b36e8d97453 req-a2b91c89-3635-49aa-899a-6a0f66810cb1 tempest-ServersTestMultiNic-541139820 tempest-ServersTestMultiNic-541139820-project-member] Enqueued Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1115.167564] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1115.167881] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.168086] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.168642] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.168862] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.169064] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.169223] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.169223] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.169411] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.169438] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.169532] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.433960] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a238fd65-d476-4f25-8c29-5e2babcc5026: rpc.has_security_group_logging(os_id): False [ 1115.455494] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.455494] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.459190] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.459190] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.459190] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.459190] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.459190] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.459190] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.459190] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.459190] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.459190] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.459190] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.459190] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.459190] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.459190] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.459190] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.459616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.459616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.459616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.459616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.459616] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a238fd65-d476-4f25-8c29-5e2babcc5026 is going to be updated. [ 1115.529415] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.529593] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.529665] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.529868] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.530014] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.547336] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: IN_PROGRESS for 2s [ 1115.550160] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-29 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.550160] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-29" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.550285] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-29" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.550510] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-29" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.550773] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.551586] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.551792] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.552245] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.552245] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.552447] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1115.552581] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1115.552701] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1115.552829] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1115.552948] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1115.553067] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1115.553205] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1115.595187] env[70520]: INFO networking_nsxv3.common.synchronization [req-ecc1daa8-19ac-492b-ad18-7b36e8d97453 req-f68cc9f5-f5d1-47aa-8b8a-9a1c8044d533 tempest-ServersTestMultiNic-541139820 tempest-ServersTestMultiNic-541139820-project-member] Enqueued Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1115.595588] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGHEST for action security_group_members [ 1115.595896] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.596010] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.616051] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1115.616282] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.063 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1115.616436] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1115.616618] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-29" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.616998] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-4852bfe5-c6e1-433f-bd50-120378bcf08a taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.617206] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-4852bfe5-c6e1-433f-bd50-120378bcf08a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.617326] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-4852bfe5-c6e1-433f-bd50-120378bcf08a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.617687] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-4852bfe5-c6e1-433f-bd50-120378bcf08a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.617861] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4852bfe5-c6e1-433f-bd50-120378bcf08a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.671487] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.121426] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.121681] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.122040] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.122226] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.122597] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.122779] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 4852bfe5-c6e1-433f-bd50-120378bcf08a not found, creating... [ 1116.123085] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.123551] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.123551] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.123742] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.123742] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.124107] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.125623] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.125623] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.125623] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.125623] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.125623] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 4852bfe5-c6e1-433f-bd50-120378bcf08a is going to be created. [ 1116.149043] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.149043] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.149043] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.149043] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.149043] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.149043] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-4852bfe5-c6e1-433f-bd50-120378bcf08a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.174056] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.556756] env[70520]: INFO networking_nsxv3.common.synchronization [None req-4c0ca4bd-db3f-45a7-842d-ff65b0a14c47 None None] Enqueued Resource ID: 3e124265-7575-434f-b0bd-45125878c9ca with Priority: HIGHEST for action port [ 1116.557441] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e124265-7575-434f-b0bd-45125878c9ca with Priority: HIGHEST for action port [ 1116.557613] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e124265-7575-434f-b0bd-45125878c9ca taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.557751] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e124265-7575-434f-b0bd-45125878c9ca" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.557827] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e124265-7575-434f-b0bd-45125878c9ca" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.558227] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e124265-7575-434f-b0bd-45125878c9ca" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.558309] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e124265-7575-434f-b0bd-45125878c9ca',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.678448] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.678448] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.678448] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.678448] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.678448] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.678448] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a238fd65-d476-4f25-8c29-5e2babcc5026 is going to be updated. [ 1116.706069] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.706210] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.706288] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.706488] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.706626] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.716512] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: IN_PROGRESS for 2s [ 1116.805328] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: SUCCESS [ 1116.805750] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.805750] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.806148] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.806410] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.806410] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.806410] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.806616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.806646] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.806742] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.806830] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.905246] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: SUCCESS [ 1116.905474] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.068763] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e124265-7575-434f-b0bd-45125878c9ca [ 1117.069017] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.069162] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.069224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.069444] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.069526] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.069618] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e124265-7575-434f-b0bd-45125878c9ca already deleted. [ 1117.069697] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e124265-7575-434f-b0bd-45125878c9ca" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.142274] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: SUCCESS [ 1117.142540] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 deletion is rescheduled due to dependency. [ 1117.142575] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.270539] env[70520]: INFO networking_nsxv3.common.synchronization [req-180835f5-c68a-4acd-bbcd-1b36f6ee4a36 req-f7f3cddb-99a9-4a6c-a76a-336ed191c798 tempest-ServersTestJSON-589199853 tempest-ServersTestJSON-589199853-project-member] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1117.271074] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1117.271398] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.271525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.271590] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.271792] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.271934] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.272250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.272334] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.272743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.272795] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.272876] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.310064] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.310300] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.310300] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.310502] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.310673] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.310772] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.310835] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.310994] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.311090] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.311178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.311318] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.311414] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.311472] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.311604] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.311734] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.311819] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.311878] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.312015] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.312095] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.312171] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.312252] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.317366] env[70520]: INFO networking_nsxv3.common.synchronization [req-0ec91a85-28d3-43d6-a743-098d5931dd40 req-1b4f1dec-7f06-4fdc-8391-91ebffc9de17 service nova] Enqueued Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_rules [ 1117.317366] env[70520]: INFO networking_nsxv3.common.synchronization [req-0ec91a85-28d3-43d6-a743-098d5931dd40 req-1b4f1dec-7f06-4fdc-8391-91ebffc9de17 service nova] Enqueued Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1117.317366] env[70520]: INFO networking_nsxv3.common.synchronization [req-0ec91a85-28d3-43d6-a743-098d5931dd40 req-1b4f1dec-7f06-4fdc-8391-91ebffc9de17 service nova] Enqueued Resource ID: 4852bfe5-c6e1-433f-bd50-120378bcf08a with Priority: HIGHEST for action port [ 1117.317366] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_rules [ 1117.317618] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1117.317618] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4852bfe5-c6e1-433f-bd50-120378bcf08a with Priority: HIGHEST for action port [ 1117.317992] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.318237] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.318319] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.318500] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.318586] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.320083] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.320205] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.320271] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.320981] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.320981] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.320981] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.320981] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.320981] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.321160] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.321160] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.326018] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-4852bfe5-c6e1-433f-bd50-120378bcf08a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.326018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4852bfe5-c6e1-433f-bd50-120378bcf08a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.326018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4852bfe5-c6e1-433f-bd50-120378bcf08a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.326018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4852bfe5-c6e1-433f-bd50-120378bcf08a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.326018] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4852bfe5-c6e1-433f-bd50-120378bcf08a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.563467] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: SUCCESS [ 1117.563725] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.776541] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.815947] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 80751702-3cad-4ef3-af48-e8bd866c7e7f: rpc.has_security_group_logging(os_id): False [ 1117.821110] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.821369] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.823649] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.826422] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4852bfe5-c6e1-433f-bd50-120378bcf08a with status ACTIVE [ 1117.826422] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.826693] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.826766] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.827027] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.827177] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.827412] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.827565] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.827664] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.827863] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.827994] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.828260] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.828458] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.828558] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.828742] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.828742] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.828840] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4852bfe5-c6e1-433f-bd50-120378bcf08a is going to be updated. [ 1117.834663] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.836145] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.836145] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.836145] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.836280] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.836447] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.836562] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.836636] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.836833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.837152] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.837152] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.837249] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.837276] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.837423] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.837509] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.837694] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.837803] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.837838] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.837978] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.838644] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.838714] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f is going to be updated. [ 1117.856604] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.856748] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.856822] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.857050] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.857186] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.857454] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4852bfe5-c6e1-433f-bd50-120378bcf08a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.863958] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-831 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.864145] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-831" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.867671] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-831" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.867671] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-831" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.867671] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.867671] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.867671] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.867671] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.867671] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.867671] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1117.867671] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1117.867671] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1117.867671] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1117.868167] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1117.868167] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1117.868167] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1117.890356] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1117.890568] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1117.890804] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1117.891072] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-831" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.891412] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-53c06dde-c794-4d21-96ee-c957b2b939d9 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.891584] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-53c06dde-c794-4d21-96ee-c957b2b939d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.891699] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-53c06dde-c794-4d21-96ee-c957b2b939d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.892036] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-53c06dde-c794-4d21-96ee-c957b2b939d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.892171] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53c06dde-c794-4d21-96ee-c957b2b939d9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.925236] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.926112] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.926112] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.926112] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.926112] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.007174] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: IN_PROGRESS for 2s [ 1118.280695] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.331762] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.394838] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.395093] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.395219] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.395541] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.395694] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.395858] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 53c06dde-c794-4d21-96ee-c957b2b939d9 not found, creating... [ 1118.396208] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.396389] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.396514] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.396766] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.396905] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.397316] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.397599] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.397599] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.397817] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.397966] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.398201] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 53c06dde-c794-4d21-96ee-c957b2b939d9 is going to be created. [ 1118.424911] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.424911] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.424911] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.424911] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.424911] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.424911] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-53c06dde-c794-4d21-96ee-c957b2b939d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.477246] env[70520]: INFO networking_nsxv3.common.synchronization [None req-d0cd2e30-6489-437e-bb1d-b743a98adc40 None None] Enqueued Resource ID: f4177eb3-dbb1-44df-aeaa-edf27c029dea with Priority: HIGHEST for action port [ 1118.478218] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4177eb3-dbb1-44df-aeaa-edf27c029dea with Priority: HIGHEST for action port [ 1118.478218] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4177eb3-dbb1-44df-aeaa-edf27c029dea taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.478339] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4177eb3-dbb1-44df-aeaa-edf27c029dea" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.478339] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4177eb3-dbb1-44df-aeaa-edf27c029dea" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.478636] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4177eb3-dbb1-44df-aeaa-edf27c029dea" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.478703] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4177eb3-dbb1-44df-aeaa-edf27c029dea',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.727306] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: SUCCESS [ 1118.727403] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.728054] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.728054] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.728054] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.728281] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.728281] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.728558] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.728558] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.728558] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.781391] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.781535] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.781586] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.781795] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.781888] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.781989] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be updated. [ 1118.834680] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.836195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.836195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.836195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.836195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.836195] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 is going to be updated. [ 1118.837680] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.837862] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.837936] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.840256] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.840256] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.855236] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: IN_PROGRESS for 2s [ 1118.876542] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.876712] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.876763] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.876979] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.877150] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.889467] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: IN_PROGRESS for 2s [ 1118.982504] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f4177eb3-dbb1-44df-aeaa-edf27c029dea [ 1118.982743] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.982879] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.982946] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.983201] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.983287] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.983446] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f4177eb3-dbb1-44df-aeaa-edf27c029dea already deleted. [ 1118.983487] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4177eb3-dbb1-44df-aeaa-edf27c029dea" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.234686] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.234686] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.234686] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.234686] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.234686] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.234686] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.234686] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.234686] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.234686] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.234686] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.234686] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a238fd65-d476-4f25-8c29-5e2babcc5026 is going to be updated. [ 1119.267851] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.270125] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.270125] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.270125] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.270125] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.279707] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: IN_PROGRESS for 2s [ 1119.362074] env[70520]: INFO networking_nsxv3.common.synchronization [req-180835f5-c68a-4acd-bbcd-1b36f6ee4a36 req-5646b1e2-eb88-4083-bd9b-4f33f26f655f service nova] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_rules [ 1119.362074] env[70520]: INFO networking_nsxv3.common.synchronization [req-180835f5-c68a-4acd-bbcd-1b36f6ee4a36 req-5646b1e2-eb88-4083-bd9b-4f33f26f655f service nova] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1119.362074] env[70520]: INFO networking_nsxv3.common.synchronization [req-180835f5-c68a-4acd-bbcd-1b36f6ee4a36 req-5646b1e2-eb88-4083-bd9b-4f33f26f655f service nova] Enqueued Resource ID: 53c06dde-c794-4d21-96ee-c957b2b939d9 with Priority: HIGHEST for action port [ 1119.362074] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_rules [ 1119.362074] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1119.362074] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53c06dde-c794-4d21-96ee-c957b2b939d9 with Priority: HIGHEST for action port [ 1119.362533] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.362533] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.362533] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.362884] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.362884] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.363945] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.364110] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.364361] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-53c06dde-c794-4d21-96ee-c957b2b939d9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.365496] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53c06dde-c794-4d21-96ee-c957b2b939d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.365496] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53c06dde-c794-4d21-96ee-c957b2b939d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.365569] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53c06dde-c794-4d21-96ee-c957b2b939d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.365599] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53c06dde-c794-4d21-96ee-c957b2b939d9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.867260] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.867497] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.867660] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 53c06dde-c794-4d21-96ee-c957b2b939d9 with status ACTIVE [ 1119.867879] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.868027] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.868188] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.868446] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.868555] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.868739] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.868892] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.868892] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.869695] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.869695] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.869695] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.869695] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.869695] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.869695] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.869976] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.869976] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 53c06dde-c794-4d21-96ee-c957b2b939d9 is going to be updated. [ 1119.915127] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.915358] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.915358] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.915464] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.915635] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.915796] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53c06dde-c794-4d21-96ee-c957b2b939d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.042570] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: SUCCESS [ 1120.042852] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.519896] env[70520]: INFO networking_nsxv3.common.synchronization [req-4eb976d2-6ca4-45b3-b8b5-b4391e514d3b req-3d5c94dc-c62c-4464-99ae-9109d3791fd5 tempest-ListServerFiltersTestJSON-1362658205 tempest-ListServerFiltersTestJSON-1362658205-project-member] Enqueued Resource ID: b635a150-2303-4a51-9fa7-6a4633e2197a with Priority: HIGHEST for action security_group_members [ 1120.520477] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b635a150-2303-4a51-9fa7-6a4633e2197a with Priority: HIGHEST for action security_group_members [ 1120.520789] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b635a150-2303-4a51-9fa7-6a4633e2197a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.520968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.520968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.525350] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.525547] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.525666] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.525735] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.525909] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.525996] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.526115] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.865508] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: SUCCESS [ 1120.865882] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.866185] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.866525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.870272] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.870272] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.870272] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.870272] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.870272] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.870272] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.899890] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: SUCCESS [ 1120.900532] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.901133] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.901561] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.902296] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.902296] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.902296] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.902296] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.902520] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.902916] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.903590] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.029449] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.029806] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.030269] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.030576] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.033870] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.033870] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.033870] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.033870] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.033870] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.033870] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.033870] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b635a150-2303-4a51-9fa7-6a4633e2197a already deleted. [ 1121.033870] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.057644] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-834 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.057907] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-834" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.058051] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-834" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.058453] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-834" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.058753] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.058925] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.059057] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.059328] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.059482] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.059700] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1121.059819] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1121.059933] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1121.060063] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1121.060181] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1121.060293] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1121.060453] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1121.085860] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1121.086244] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1121.086430] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1121.086619] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-834" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.086929] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-f3599afb-1d51-4944-ac95-636aa31a92cf taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.087122] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-f3599afb-1d51-4944-ac95-636aa31a92cf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.087245] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-f3599afb-1d51-4944-ac95-636aa31a92cf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.087561] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-f3599afb-1d51-4944-ac95-636aa31a92cf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.087700] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3599afb-1d51-4944-ac95-636aa31a92cf',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.292985] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a238fd65-d476-4f25-8c29-5e2babcc5026 in Status: SUCCESS [ 1121.293199] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a238fd65-d476-4f25-8c29-5e2babcc5026 deletion is rescheduled due to dependency. [ 1121.293692] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.362737] env[70520]: INFO networking_nsxv3.common.synchronization [req-91ad8ddb-0ff3-4fca-824b-c9ed043cfd71 req-9bb166c8-6353-40f9-b9ed-1750ba11d157 tempest-ServerDiskConfigTestJSON-984450191 tempest-ServerDiskConfigTestJSON-984450191-project-member] Enqueued Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 1121.362737] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23aa860-12db-4b07-ac46-cf4709db7164 with Priority: HIGHEST for action security_group_members [ 1121.362737] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23aa860-12db-4b07-ac46-cf4709db7164 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.362972] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.362972] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.363702] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.363702] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.363702] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.363853] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.363911] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.363996] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.364105] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a23aa860-12db-4b07-ac46-cf4709db7164',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.372510] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.405677] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.405876] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.405950] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.406306] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.406467] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.406533] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.406592] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.406984] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.407147] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.407246] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.407476] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.407577] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.407651] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.407839] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.409318] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.409318] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.409318] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.409318] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.409318] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.409318] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.409318] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.590471] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.590893] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.590893] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.591252] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.591449] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.591686] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port f3599afb-1d51-4944-ac95-636aa31a92cf not found, creating... [ 1121.592012] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.592299] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.592580] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.594419] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.594780] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.595548] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.595795] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.596088] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.596482] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.596801] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.597118] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: f3599afb-1d51-4944-ac95-636aa31a92cf is going to be created. [ 1121.626893] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.627134] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.627270] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.627585] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.627827] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.628090] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-f3599afb-1d51-4944-ac95-636aa31a92cf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.868833] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.868833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.868833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.868833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.868833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.868833] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.868833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.868833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.868833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.868833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.868833] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 is going to be updated. [ 1121.875561] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.898098] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.898399] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.898496] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.898848] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.899039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.912365] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 468bd631-24dc-43d9-8a0f-93dcf753e208: rpc.has_security_group_logging(os_id): False [ 1121.932916] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: IN_PROGRESS for 2s [ 1121.934647] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.934947] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.934947] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.935103] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.935152] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.935353] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.935456] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.935512] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.935662] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.935738] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.935913] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.936072] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.936187] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.936233] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.936305] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.936477] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.936570] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.936629] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.936765] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.936837] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.936919] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 is going to be updated. [ 1122.012794] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.013011] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.013011] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.013259] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.013411] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.032949] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: IN_PROGRESS for 2s [ 1122.359466] env[70520]: INFO networking_nsxv3.common.synchronization [req-4eb976d2-6ca4-45b3-b8b5-b4391e514d3b req-0ba7bf0a-e57c-4d3f-8aca-3a39ae2fd00b service nova] Enqueued Resource ID: b635a150-2303-4a51-9fa7-6a4633e2197a with Priority: HIGHEST for action security_group_rules [ 1122.359466] env[70520]: INFO networking_nsxv3.common.synchronization [req-4eb976d2-6ca4-45b3-b8b5-b4391e514d3b req-0ba7bf0a-e57c-4d3f-8aca-3a39ae2fd00b service nova] Enqueued Resource ID: b635a150-2303-4a51-9fa7-6a4633e2197a with Priority: HIGHEST for action security_group_members [ 1122.359466] env[70520]: INFO networking_nsxv3.common.synchronization [req-4eb976d2-6ca4-45b3-b8b5-b4391e514d3b req-0ba7bf0a-e57c-4d3f-8aca-3a39ae2fd00b service nova] Enqueued Resource ID: f3599afb-1d51-4944-ac95-636aa31a92cf with Priority: HIGHEST for action port [ 1122.359950] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b635a150-2303-4a51-9fa7-6a4633e2197a with Priority: HIGHEST for action security_group_rules [ 1122.360550] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b635a150-2303-4a51-9fa7-6a4633e2197a with Priority: HIGHEST for action security_group_members [ 1122.360672] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3599afb-1d51-4944-ac95-636aa31a92cf with Priority: HIGHEST for action port [ 1122.360988] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b635a150-2303-4a51-9fa7-6a4633e2197a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.361178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.361228] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.361546] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.361654] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.363318] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b635a150-2303-4a51-9fa7-6a4633e2197a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.363439] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.363505] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.363692] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.363949] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.364358] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.364358] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.364358] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.364469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.364566] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.365517] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3599afb-1d51-4944-ac95-636aa31a92cf taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.365650] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3599afb-1d51-4944-ac95-636aa31a92cf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.365709] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3599afb-1d51-4944-ac95-636aa31a92cf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.366478] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3599afb-1d51-4944-ac95-636aa31a92cf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.366478] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3599afb-1d51-4944-ac95-636aa31a92cf',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.377780] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.377928] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.377991] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.378584] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.378584] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.378584] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be updated. [ 1122.408555] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.408821] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.408949] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.409296] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.409563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.421750] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: IN_PROGRESS for 2s [ 1122.868100] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.869742] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b635a150-2303-4a51-9fa7-6a4633e2197a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.869742] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.869742] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3599afb-1d51-4944-ac95-636aa31a92cf with status ACTIVE [ 1122.869742] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.869742] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.870032] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.870032] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.870083] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.870470] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.870470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.870470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.870620] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.871721] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.872053] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.872546] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.872546] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.872546] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.872656] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.872656] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3599afb-1d51-4944-ac95-636aa31a92cf is going to be updated. [ 1122.898482] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.899100] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.899267] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.899550] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.899785] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.899970] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3599afb-1d51-4944-ac95-636aa31a92cf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.054529] env[70520]: INFO networking_nsxv3.common.synchronization [req-d5ba5f38-f8d0-4118-9757-a6d0789611ab req-35ccb0f7-f69a-4891-8202-126ed6150336 tempest-ListServerFiltersTestJSON-1362658205 tempest-ListServerFiltersTestJSON-1362658205-project-member] Enqueued Resource ID: b635a150-2303-4a51-9fa7-6a4633e2197a with Priority: HIGHEST for action security_group_members [ 1123.055229] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b635a150-2303-4a51-9fa7-6a4633e2197a with Priority: HIGHEST for action security_group_members [ 1123.055555] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b635a150-2303-4a51-9fa7-6a4633e2197a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.055654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.375457] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.397284] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-834 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.398582] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-834" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.398582] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-834" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.400335] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-834" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.400335] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.400335] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.400574] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.401534] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.401534] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.401534] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1123.401534] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1123.401534] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1123.401534] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1123.401736] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1123.401773] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1123.401918] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1123.424258] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1123.424258] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1123.424258] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1123.424258] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-834" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.424258] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-5933f6e5-2109-4c96-9253-a9586e5a6bdc taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.424258] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-5933f6e5-2109-4c96-9253-a9586e5a6bdc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.424258] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-5933f6e5-2109-4c96-9253-a9586e5a6bdc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.424258] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-5933f6e5-2109-4c96-9253-a9586e5a6bdc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.424942] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5933f6e5-2109-4c96-9253-a9586e5a6bdc',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.878127] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.878127] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.878127] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.878127] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.878127] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.878762] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b635a150-2303-4a51-9fa7-6a4633e2197a is going to be created. [ 1123.908772] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.909063] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.909227] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.909583] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.909935] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.921917] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b635a150-2303-4a51-9fa7-6a4633e2197a in Status: UNINITIALIZED for 2s [ 1123.927838] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.928128] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.928307] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.928585] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.928741] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.928905] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 5933f6e5-2109-4c96-9253-a9586e5a6bdc not found, creating... [ 1123.929243] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.929402] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.929527] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.929755] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.929897] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.930218] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.930373] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.930519] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.930709] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.930844] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.930987] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 5933f6e5-2109-4c96-9253-a9586e5a6bdc is going to be created. [ 1123.942140] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23aa860-12db-4b07-ac46-cf4709db7164 in Status: SUCCESS [ 1123.942330] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a23aa860-12db-4b07-ac46-cf4709db7164 deletion is rescheduled due to dependency. [ 1123.942451] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23aa860-12db-4b07-ac46-cf4709db7164" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.951125] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.951354] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.951480] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.951829] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.952117] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.952345] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-5933f6e5-2109-4c96-9253-a9586e5a6bdc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.052180] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: SUCCESS [ 1124.052546] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.435904] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: SUCCESS [ 1124.436241] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.436997] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.437991] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.437991] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.437991] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.437991] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.437991] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.437991] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.437991] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.438469] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.868014] env[70520]: INFO networking_nsxv3.common.synchronization [req-d5ba5f38-f8d0-4118-9757-a6d0789611ab req-c3b2e854-cf36-4adb-aee5-32caa0dddbc9 service nova] Enqueued Resource ID: b635a150-2303-4a51-9fa7-6a4633e2197a with Priority: HIGHEST for action security_group_rules [ 1124.868258] env[70520]: INFO networking_nsxv3.common.synchronization [req-d5ba5f38-f8d0-4118-9757-a6d0789611ab req-c3b2e854-cf36-4adb-aee5-32caa0dddbc9 service nova] Enqueued Resource ID: b635a150-2303-4a51-9fa7-6a4633e2197a with Priority: HIGHEST for action security_group_members [ 1124.868419] env[70520]: INFO networking_nsxv3.common.synchronization [req-d5ba5f38-f8d0-4118-9757-a6d0789611ab req-c3b2e854-cf36-4adb-aee5-32caa0dddbc9 service nova] Enqueued Resource ID: 5933f6e5-2109-4c96-9253-a9586e5a6bdc with Priority: HIGHEST for action port [ 1124.868647] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b635a150-2303-4a51-9fa7-6a4633e2197a with Priority: HIGHEST for action security_group_rules [ 1124.868773] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b635a150-2303-4a51-9fa7-6a4633e2197a with Priority: HIGHEST for action security_group_members [ 1124.868865] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5933f6e5-2109-4c96-9253-a9586e5a6bdc with Priority: HIGHEST for action port [ 1124.869458] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b635a150-2303-4a51-9fa7-6a4633e2197a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.869619] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.869760] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b635a150-2303-4a51-9fa7-6a4633e2197a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.869863] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.870018] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-5933f6e5-2109-4c96-9253-a9586e5a6bdc taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.870150] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5933f6e5-2109-4c96-9253-a9586e5a6bdc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.870210] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5933f6e5-2109-4c96-9253-a9586e5a6bdc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.870413] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5933f6e5-2109-4c96-9253-a9586e5a6bdc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.870503] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5933f6e5-2109-4c96-9253-a9586e5a6bdc',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.940911] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.941238] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.941238] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.941416] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.941650] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.941650] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.941777] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.942708] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.942708] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.942708] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.942708] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.942708] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.942708] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.942708] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.942708] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.942708] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.942708] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.943086] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.943086] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.943086] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.943086] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.372259] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5933f6e5-2109-4c96-9253-a9586e5a6bdc with status ACTIVE [ 1125.372744] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.372971] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.373103] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.373439] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.374268] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.374268] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.374268] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.374268] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.374268] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.374465] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.374544] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.374642] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.374716] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.374874] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.374967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.375078] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5933f6e5-2109-4c96-9253-a9586e5a6bdc is going to be updated. [ 1125.399714] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.400271] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.400271] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.400271] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.400429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.400560] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5933f6e5-2109-4c96-9253-a9586e5a6bdc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.445464] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a927ecd-fa02-4905-9c80-5ef71a14a848: rpc.has_security_group_logging(os_id): False [ 1125.479240] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.479397] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.479466] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.479680] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.479764] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.479990] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.480101] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.480160] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.480308] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.480378] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.480727] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.480823] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.480880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.481033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.481102] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.481276] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.481360] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.481416] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.481548] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.481615] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.481735] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be updated. [ 1125.566363] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.566593] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.566696] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.566967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.567168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.586145] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: IN_PROGRESS for 2s [ 1125.935803] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b635a150-2303-4a51-9fa7-6a4633e2197a in Status: SUCCESS [ 1125.935803] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.935803] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.935803] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.935803] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.935803] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.935803] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.935803] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.935803] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.935803] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.935803] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.937305] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.937797] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.938586] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.938840] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.938983] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.939255] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.940262] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.940262] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.442140] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b635a150-2303-4a51-9fa7-6a4633e2197a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.442533] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.442533] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.630417] env[70520]: INFO networking_nsxv3.common.synchronization [req-9d1a900c-ba16-4311-9cb7-2abf575b2d8e req-316cc63f-b3ee-4487-b6eb-a13a262a8ee9 tempest-AttachInterfacesTestJSON-1687744298 tempest-AttachInterfacesTestJSON-1687744298-project-member] Enqueued Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_members [ 1126.630910] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_members [ 1126.631671] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.631671] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.631671] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.631671] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.632481] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.632481] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.632481] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.632915] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.633232] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.633232] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.946650] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.136096] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.137334] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.137334] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.137334] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.137334] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.137334] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.137334] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.137334] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.140154] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.140154] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.140154] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a is going to be updated. [ 1127.178285] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.178285] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.178285] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.178285] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.178285] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.191475] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: IN_PROGRESS for 2s [ 1127.271172] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-631 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.271465] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.271635] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.271963] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.275440] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.275653] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.276016] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.276087] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.276263] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.276529] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1127.276652] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1127.276767] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1127.276879] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1127.276993] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1127.277130] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1127.277278] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1127.297948] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1127.298166] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1127.298373] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1127.298606] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.298974] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-0fecb555-3a8e-4a86-9406-f09bd3c74454 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.300082] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-0fecb555-3a8e-4a86-9406-f09bd3c74454" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.300230] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-0fecb555-3a8e-4a86-9406-f09bd3c74454" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.300693] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-0fecb555-3a8e-4a86-9406-f09bd3c74454" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.300859] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fecb555-3a8e-4a86-9406-f09bd3c74454',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.447966] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.448403] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.448403] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.448502] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.448554] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.448657] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b635a150-2303-4a51-9fa7-6a4633e2197a is going to be updated. [ 1127.477587] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.477736] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.477793] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.478017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.478167] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.487948] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b635a150-2303-4a51-9fa7-6a4633e2197a in Status: IN_PROGRESS for 2s [ 1127.554658] env[70520]: INFO networking_nsxv3.common.synchronization [req-35641232-c1e2-4ee8-8818-4211121fa718 req-eb14b664-4678-4ab8-820e-3f057bf2b396 tempest-ListServerFiltersTestJSON-1362658205 tempest-ListServerFiltersTestJSON-1362658205-project-member] Enqueued Resource ID: b635a150-2303-4a51-9fa7-6a4633e2197a with Priority: HIGHEST for action security_group_members [ 1127.554658] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b635a150-2303-4a51-9fa7-6a4633e2197a with Priority: HIGHEST for action security_group_members [ 1127.554658] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b635a150-2303-4a51-9fa7-6a4633e2197a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.554658] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.620587] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: SUCCESS [ 1127.620975] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.806925] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.806925] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.806925] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.806925] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.806925] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.806925] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 0fecb555-3a8e-4a86-9406-f09bd3c74454 not found, creating... [ 1127.806925] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.806925] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.806925] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.806925] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.806925] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.807396] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.807396] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.807396] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.807396] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.807396] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.807396] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 0fecb555-3a8e-4a86-9406-f09bd3c74454 is going to be created. [ 1127.834376] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.834376] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.834376] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.834376] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.834376] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.834376] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-0fecb555-3a8e-4a86-9406-f09bd3c74454" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.903914] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-834 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.904165] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-834" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.904335] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-834" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.904639] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-834" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.904918] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.905083] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.905204] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.905432] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.905613] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.905786] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1127.905900] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1127.906027] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1127.906140] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1127.906333] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1127.906448] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1127.906581] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1127.938029] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1127.938181] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1127.938394] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1127.938588] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-834" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.938907] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-2eefc8a0-e6d4-412b-b328-c5d9ac998950 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.939094] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-2eefc8a0-e6d4-412b-b328-c5d9ac998950" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.939241] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-2eefc8a0-e6d4-412b-b328-c5d9ac998950" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.939584] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-2eefc8a0-e6d4-412b-b328-c5d9ac998950" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.939718] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2eefc8a0-e6d4-412b-b328-c5d9ac998950',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.442228] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.442503] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.442639] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.442962] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.443138] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.443317] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 2eefc8a0-e6d4-412b-b328-c5d9ac998950 not found, creating... [ 1128.443736] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.443927] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.444071] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.444315] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.444530] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.444757] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.444914] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.445045] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.445265] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.445420] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.445564] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 2eefc8a0-e6d4-412b-b328-c5d9ac998950 is going to be created. [ 1128.468179] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.468618] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.468728] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.473136] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.473448] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.473699] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-2eefc8a0-e6d4-412b-b328-c5d9ac998950" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.743104] env[70520]: INFO networking_nsxv3.common.synchronization [req-9d1a900c-ba16-4311-9cb7-2abf575b2d8e req-c680ac63-ebec-4e60-9fad-34f8d5878faf service nova] Enqueued Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_rules [ 1128.743104] env[70520]: INFO networking_nsxv3.common.synchronization [req-9d1a900c-ba16-4311-9cb7-2abf575b2d8e req-c680ac63-ebec-4e60-9fad-34f8d5878faf service nova] Enqueued Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_members [ 1128.743104] env[70520]: INFO networking_nsxv3.common.synchronization [req-9d1a900c-ba16-4311-9cb7-2abf575b2d8e req-c680ac63-ebec-4e60-9fad-34f8d5878faf service nova] Enqueued Resource ID: 0fecb555-3a8e-4a86-9406-f09bd3c74454 with Priority: HIGHEST for action port [ 1128.743420] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_rules [ 1128.743531] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_members [ 1128.743680] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fecb555-3a8e-4a86-9406-f09bd3c74454 with Priority: HIGHEST for action port [ 1128.744211] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.744406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.744585] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.744833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.745160] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.747640] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.747821] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.748173] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-0fecb555-3a8e-4a86-9406-f09bd3c74454 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.748391] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0fecb555-3a8e-4a86-9406-f09bd3c74454" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.748489] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0fecb555-3a8e-4a86-9406-f09bd3c74454" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.748797] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0fecb555-3a8e-4a86-9406-f09bd3c74454" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.749181] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fecb555-3a8e-4a86-9406-f09bd3c74454',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.007466] env[70520]: INFO networking_nsxv3.common.synchronization [req-363a6e89-8815-41af-9097-2a6072b14fe5 req-54e43ff6-02be-4e63-9d2e-77918fd6f415 tempest-DeleteServersTestJSON-1399047283 tempest-DeleteServersTestJSON-1399047283-project-member] Enqueued Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 1129.008032] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 1129.008427] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.008621] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.008621] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.009193] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.012123] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.012123] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.012285] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.012489] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.012607] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.013276] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.205918] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: SUCCESS [ 1129.206363] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a deletion is rescheduled due to dependency. [ 1129.206363] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.206713] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.206713] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.206963] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.207150] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.207240] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.207454] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.207562] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.207698] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.254784] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0fecb555-3a8e-4a86-9406-f09bd3c74454 with status ACTIVE [ 1129.255286] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.255286] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.255286] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.255476] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.255554] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.255691] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.255793] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.255851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.255996] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.256086] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.256260] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.256514] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.256514] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.256967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.257262] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.257262] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0fecb555-3a8e-4a86-9406-f09bd3c74454 is going to be updated. [ 1129.258280] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.258383] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.280483] env[70520]: INFO networking_nsxv3.common.synchronization [req-35641232-c1e2-4ee8-8818-4211121fa718 req-8b63c648-e4cf-477c-a839-e2d77b0d2729 service nova] Enqueued Resource ID: b635a150-2303-4a51-9fa7-6a4633e2197a with Priority: HIGHEST for action security_group_rules [ 1129.280591] env[70520]: INFO networking_nsxv3.common.synchronization [req-35641232-c1e2-4ee8-8818-4211121fa718 req-8b63c648-e4cf-477c-a839-e2d77b0d2729 service nova] Enqueued Resource ID: b635a150-2303-4a51-9fa7-6a4633e2197a with Priority: HIGHEST for action security_group_members [ 1129.280693] env[70520]: INFO networking_nsxv3.common.synchronization [req-35641232-c1e2-4ee8-8818-4211121fa718 req-8b63c648-e4cf-477c-a839-e2d77b0d2729 service nova] Enqueued Resource ID: 2eefc8a0-e6d4-412b-b328-c5d9ac998950 with Priority: HIGHEST for action port [ 1129.280928] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b635a150-2303-4a51-9fa7-6a4633e2197a with Priority: HIGHEST for action security_group_rules [ 1129.281793] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b635a150-2303-4a51-9fa7-6a4633e2197a with Priority: HIGHEST for action security_group_members [ 1129.281793] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eefc8a0-e6d4-412b-b328-c5d9ac998950 with Priority: HIGHEST for action port [ 1129.281793] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b635a150-2303-4a51-9fa7-6a4633e2197a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.282013] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.282099] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b635a150-2303-4a51-9fa7-6a4633e2197a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.282215] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.282339] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-2eefc8a0-e6d4-412b-b328-c5d9ac998950 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.282538] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2eefc8a0-e6d4-412b-b328-c5d9ac998950" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.282538] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2eefc8a0-e6d4-412b-b328-c5d9ac998950" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.282720] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2eefc8a0-e6d4-412b-b328-c5d9ac998950" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.282773] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2eefc8a0-e6d4-412b-b328-c5d9ac998950',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.284377] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.284508] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.284561] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.285166] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.285166] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.285166] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0fecb555-3a8e-4a86-9406-f09bd3c74454" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.497532] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b635a150-2303-4a51-9fa7-6a4633e2197a in Status: SUCCESS [ 1129.497815] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.497986] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.498284] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.498494] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.498624] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.498691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.498878] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.498988] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.499110] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.517234] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.517399] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.517450] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.517679] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.517768] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.518010] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.518111] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.518299] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.518452] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.518535] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.518628] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f is going to be updated. [ 1129.547724] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.547902] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.547970] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.548181] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.548452] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.559162] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: IN_PROGRESS for 2s [ 1129.709655] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.786042] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2eefc8a0-e6d4-412b-b328-c5d9ac998950 with status ACTIVE [ 1129.786293] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.786366] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.786446] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.786707] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.786801] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.786998] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.787126] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.787192] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.787342] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.787418] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.787607] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.787706] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.787765] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.787930] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.788013] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.788112] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2eefc8a0-e6d4-412b-b328-c5d9ac998950 is going to be updated. [ 1129.814907] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.816184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.816184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.816184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.816184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.816184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2eefc8a0-e6d4-412b-b328-c5d9ac998950" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.001915] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.212962] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.221460] env[70520]: INFO networking_nsxv3.common.synchronization [None req-1c8dedb8-6792-4179-ba62-126d7e9d71fd tempest-AttachVolumeNegativeTest-1224878754 tempest-AttachVolumeNegativeTest-1224878754-project-member] Enqueued Resource ID: 9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb with Priority: HIGHEST for action security_group_rules [ 1130.222140] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb with Priority: HIGHEST for action security_group_rules [ 1130.222505] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.222699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.222830] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.223246] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.223345] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.334252] env[70520]: INFO networking_nsxv3.common.synchronization [None req-bb00a172-8fee-452b-8ca1-c09dcb80facf tempest-AttachVolumeNegativeTest-1224878754 tempest-AttachVolumeNegativeTest-1224878754-project-member] Enqueued Resource ID: 9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb with Priority: HIGHEST for action security_group_rules [ 1130.334827] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb with Priority: HIGHEST for action security_group_rules [ 1130.335363] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.335479] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.504505] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.719652] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.719883] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.720072] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.720233] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.720774] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.720774] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a is going to be updated. [ 1130.749126] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.749126] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.749126] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.749126] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.749126] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.749126] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb already deleted. [ 1130.749126] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.749126] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.749126] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.749701] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.757974] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.758178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.758216] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.758703] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.758879] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.769936] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: IN_PROGRESS for 2s [ 1131.006792] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.007046] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.007126] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.008092] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.008092] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.008092] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b635a150-2303-4a51-9fa7-6a4633e2197a is going to be updated. [ 1131.036898] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.037132] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.037249] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.037518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.038575] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.050602] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b635a150-2303-4a51-9fa7-6a4633e2197a in Status: IN_PROGRESS for 2s [ 1131.271747] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.271898] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.271989] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.272253] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.272360] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.272526] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb already deleted. [ 1131.272575] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.574793] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: SUCCESS [ 1131.574793] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f deletion is rescheduled due to dependency. [ 1131.574793] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.351755] env[70520]: INFO networking_nsxv3.common.synchronization [req-d833cfa4-d679-435a-87f7-b5fcc14f55fc req-0a1ad249-aaa1-4ee5-bfb0-3e203f0c4c39 tempest-ServersTestJSON-589199853 tempest-ServersTestJSON-589199853-project-member] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1132.352390] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1132.352615] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.353181] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.353265] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.354020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.354020] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.354020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.354020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.354020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.354301] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.354301] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.781574] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: SUCCESS [ 1132.782118] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.782118] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.782263] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.782407] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.782530] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.782605] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.782743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.782833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.782905] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.783013] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.857485] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.061601] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b635a150-2303-4a51-9fa7-6a4633e2197a in Status: SUCCESS [ 1133.061840] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.062022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.062342] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.062510] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.062665] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.062665] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.062764] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.062920] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.062920] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.063122] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b635a150-2303-4a51-9fa7-6a4633e2197a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.063122] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.063252] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.063406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.063458] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.063594] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.063594] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.063720] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.063792] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.063869] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.063962] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.064921] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.066150] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.066150] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.066150] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.066150] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.066150] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.066150] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.066150] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.285053] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.285223] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.285223] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.285395] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.285571] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.285697] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.285750] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.285907] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.285989] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.286089] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.286241] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.286330] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.286387] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.286524] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.286654] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.286738] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.286795] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.286929] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.286996] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.287086] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.287180] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.360295] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.568083] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b635a150-2303-4a51-9fa7-6a4633e2197a: rpc.has_security_group_logging(os_id): False [ 1133.569387] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.592894] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.593172] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.593288] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.593502] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.593630] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.593826] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.593991] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.593991] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.594172] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.594290] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.594460] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.594575] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.594645] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.594787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.594872] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.595322] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.595410] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.595477] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.595613] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.595691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.595781] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b635a150-2303-4a51-9fa7-6a4633e2197a is going to be created. [ 1133.599365] env[70520]: INFO networking_nsxv3.common.synchronization [req-f88ebec0-cd5e-4a31-b1c3-47e32b35d583 req-a5666554-9c1b-4c4f-8f41-293c52249ea4 tempest-InstanceActionsNegativeTestJSON-1765654458 tempest-InstanceActionsNegativeTestJSON-1765654458-project-member] Enqueued Resource ID: 768b6942-2f10-48d5-8100-f6905c1e030d with Priority: HIGHEST for action security_group_members [ 1133.600170] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 768b6942-2f10-48d5-8100-f6905c1e030d with Priority: HIGHEST for action security_group_members [ 1133.600565] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-768b6942-2f10-48d5-8100-f6905c1e030d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.600708] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.600791] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.601032] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.601206] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.601309] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.601376] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.601530] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.601615] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.601713] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('768b6942-2f10-48d5-8100-f6905c1e030d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.672100] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.672328] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.672328] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.672699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.672902] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.687319] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b635a150-2303-4a51-9fa7-6a4633e2197a in Status: IN_PROGRESS for 2s [ 1133.792101] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d217c04a-3f61-40d6-89c2-a60cc7eb772a: rpc.has_security_group_logging(os_id): False [ 1133.835868] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.836189] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.836265] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.836482] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.836609] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.836796] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.836898] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.836961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.837132] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.837209] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.837413] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.837508] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.837569] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.837715] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.837786] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.837964] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.838125] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.838212] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.838426] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.838502] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.838588] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a is going to be updated. [ 1133.863430] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.863679] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.863679] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.863791] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.863857] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.863972] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be updated. [ 1133.896151] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.896300] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.896366] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.896848] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.896848] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.907293] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: IN_PROGRESS for 2s [ 1133.938836] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.939071] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.939188] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.939430] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.939584] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.943112] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-228 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.943457] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-228" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.943565] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-228" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.943927] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-228" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.944238] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.944453] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.944600] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.944839] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.944987] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.945212] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1133.945328] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1133.945442] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1133.945552] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1133.945663] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1133.945820] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1133.946067] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1133.959943] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: IN_PROGRESS for 2s [ 1133.968919] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1133.969128] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1133.969278] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1133.969556] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-228" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.969982] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-de37688f-4842-4666-91b4-4d5167bca716 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.970165] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-de37688f-4842-4666-91b4-4d5167bca716" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.970474] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-de37688f-4842-4666-91b4-4d5167bca716" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.970705] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-de37688f-4842-4666-91b4-4d5167bca716" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.970864] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de37688f-4842-4666-91b4-4d5167bca716',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.071704] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.104396] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.104594] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.104641] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.104842] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.104934] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.105164] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.105269] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.105333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.105486] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.105583] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.105810] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 768b6942-2f10-48d5-8100-f6905c1e030d already deleted. [ 1134.105962] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.473467] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.473708] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.473840] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.474163] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.474317] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.474616] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port de37688f-4842-4666-91b4-4d5167bca716 not found, creating... [ 1134.474746] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.474968] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.475073] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.475248] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.475388] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.475674] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.475830] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.475948] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.476234] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.476389] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.476661] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: de37688f-4842-4666-91b4-4d5167bca716 is going to be created. [ 1134.500538] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.500796] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.500979] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.501324] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.501627] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.501878] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-de37688f-4842-4666-91b4-4d5167bca716" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.574170] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.574337] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.574501] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.574624] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.574711] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.574891] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b635a150-2303-4a51-9fa7-6a4633e2197a is going to be updated. [ 1134.616893] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.617078] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.617152] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.618120] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.618235] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.638826] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b635a150-2303-4a51-9fa7-6a4633e2197a in Status: IN_PROGRESS for 2s [ 1134.945553] env[70520]: INFO networking_nsxv3.common.synchronization [None req-50757ed8-5a77-4a64-94a5-2e0524e6e570 tempest-AttachInterfacesTestJSON-1687744298 tempest-AttachInterfacesTestJSON-1687744298-project-member] Enqueued Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_members [ 1134.946822] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_members [ 1134.946822] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.946822] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.946822] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.947040] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.947319] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.947319] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.947319] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.947481] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.947568] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.947643] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.302355] env[70520]: INFO networking_nsxv3.common.synchronization [req-f88ebec0-cd5e-4a31-b1c3-47e32b35d583 req-29a882e2-8d0a-42bf-b2cb-d52ec2df4bd2 service nova] Enqueued Resource ID: 768b6942-2f10-48d5-8100-f6905c1e030d with Priority: HIGHEST for action security_group_rules [ 1135.302355] env[70520]: INFO networking_nsxv3.common.synchronization [req-f88ebec0-cd5e-4a31-b1c3-47e32b35d583 req-29a882e2-8d0a-42bf-b2cb-d52ec2df4bd2 service nova] Enqueued Resource ID: 768b6942-2f10-48d5-8100-f6905c1e030d with Priority: HIGHEST for action security_group_members [ 1135.302355] env[70520]: INFO networking_nsxv3.common.synchronization [req-f88ebec0-cd5e-4a31-b1c3-47e32b35d583 req-29a882e2-8d0a-42bf-b2cb-d52ec2df4bd2 service nova] Enqueued Resource ID: de37688f-4842-4666-91b4-4d5167bca716 with Priority: HIGHEST for action port [ 1135.302355] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 768b6942-2f10-48d5-8100-f6905c1e030d with Priority: HIGHEST for action security_group_rules [ 1135.302355] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 768b6942-2f10-48d5-8100-f6905c1e030d with Priority: HIGHEST for action security_group_members [ 1135.302839] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de37688f-4842-4666-91b4-4d5167bca716 with Priority: HIGHEST for action port [ 1135.303406] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-768b6942-2f10-48d5-8100-f6905c1e030d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.303738] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.303909] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.304284] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.304464] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('768b6942-2f10-48d5-8100-f6905c1e030d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.310025] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-768b6942-2f10-48d5-8100-f6905c1e030d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.310025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.310025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.310025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.310025] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.310025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.313034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.313034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.313034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.313034] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('768b6942-2f10-48d5-8100-f6905c1e030d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.313034] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-de37688f-4842-4666-91b4-4d5167bca716 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.314298] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de37688f-4842-4666-91b4-4d5167bca716" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.314423] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de37688f-4842-4666-91b4-4d5167bca716" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.314698] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de37688f-4842-4666-91b4-4d5167bca716" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.314868] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de37688f-4842-4666-91b4-4d5167bca716',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.450032] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.702299] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b635a150-2303-4a51-9fa7-6a4633e2197a in Status: SUCCESS [ 1135.702935] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.702935] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.703195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.703384] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.817629] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-768b6942-2f10-48d5-8100-f6905c1e030d taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.817629] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.817629] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('768b6942-2f10-48d5-8100-f6905c1e030d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.818581] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de37688f-4842-4666-91b4-4d5167bca716 with status ACTIVE [ 1135.818752] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.818838] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.818951] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.819284] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.819375] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.819658] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.819773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.819849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.820675] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.821514] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.821746] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.821872] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.823241] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.823488] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.823608] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.823726] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de37688f-4842-4666-91b4-4d5167bca716 is going to be updated. [ 1135.864920] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.865776] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.865848] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.866223] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.866320] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.866523] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de37688f-4842-4666-91b4-4d5167bca716" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.926530] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: SUCCESS [ 1135.928029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.954233] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.978522] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: SUCCESS [ 1135.978830] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.206380] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b635a150-2303-4a51-9fa7-6a4633e2197a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.206380] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.326352] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('768b6942-2f10-48d5-8100-f6905c1e030d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.456660] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.456806] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.456874] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.457108] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.457198] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.457295] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a is going to be updated. [ 1136.489257] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.489416] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.489476] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.489771] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.489937] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.501915] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: IN_PROGRESS for 2s [ 1136.649632] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b635a150-2303-4a51-9fa7-6a4633e2197a in Status: SUCCESS [ 1136.649861] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.650048] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.650283] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.650498] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.650624] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.650710] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.650874] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.650954] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.651155] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.831589] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.831736] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.831772] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.832370] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.832370] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.832370] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 768b6942-2f10-48d5-8100-f6905c1e030d is going to be created. [ 1136.858706] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.858706] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.858891] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.859619] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.859619] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.872528] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 768b6942-2f10-48d5-8100-f6905c1e030d in Status: UNINITIALIZED for 2s [ 1137.153173] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.242964] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-631 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.243210] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.243378] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.243686] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.244029] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.244238] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.244376] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.244658] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.244851] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.245129] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1137.245273] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1137.245412] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1137.245550] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1137.245703] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1137.245829] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1137.245990] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1137.266604] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1137.266795] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1137.266949] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1137.267172] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.267499] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-da86fb94-092b-4e94-9f72-77721773f6fc taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.267738] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-da86fb94-092b-4e94-9f72-77721773f6fc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.267852] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-da86fb94-092b-4e94-9f72-77721773f6fc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.268230] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-da86fb94-092b-4e94-9f72-77721773f6fc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.268477] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da86fb94-092b-4e94-9f72-77721773f6fc',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.657764] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.771578] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.771890] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.772103] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.772510] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.772730] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.772948] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port da86fb94-092b-4e94-9f72-77721773f6fc not found, creating... [ 1137.773352] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.773583] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.773753] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.778162] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.778483] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.778943] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.779254] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.779421] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.779747] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.779974] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.780214] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: da86fb94-092b-4e94-9f72-77721773f6fc is going to be created. [ 1137.804496] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.804721] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.804865] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.805173] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.805451] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.805626] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-da86fb94-092b-4e94-9f72-77721773f6fc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.163547] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.163547] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.163547] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.163547] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.163547] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.163547] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b635a150-2303-4a51-9fa7-6a4633e2197a is going to be updated. [ 1138.197413] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.197616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.197729] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.198173] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.198341] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.212926] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b635a150-2303-4a51-9fa7-6a4633e2197a in Status: IN_PROGRESS for 2s [ 1138.514516] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: SUCCESS [ 1138.514776] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.798713] env[70520]: INFO networking_nsxv3.common.synchronization [req-2e2431f5-4cc8-4712-9522-04f062b82780 req-6f77451b-ee91-4ecf-a8b8-e0fbd7649ad1 service nova] Enqueued Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_rules [ 1138.798713] env[70520]: INFO networking_nsxv3.common.synchronization [req-2e2431f5-4cc8-4712-9522-04f062b82780 req-6f77451b-ee91-4ecf-a8b8-e0fbd7649ad1 service nova] Enqueued Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_members [ 1138.798713] env[70520]: INFO networking_nsxv3.common.synchronization [req-2e2431f5-4cc8-4712-9522-04f062b82780 req-6f77451b-ee91-4ecf-a8b8-e0fbd7649ad1 service nova] Enqueued Resource ID: da86fb94-092b-4e94-9f72-77721773f6fc with Priority: HIGHEST for action port [ 1138.799703] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_rules [ 1138.800041] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_members [ 1138.800311] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da86fb94-092b-4e94-9f72-77721773f6fc with Priority: HIGHEST for action port [ 1138.801146] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.801486] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.801636] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.802320] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.802575] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.803915] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.804204] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.804480] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.805361] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.807013] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.807013] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.807013] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.809645] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.809645] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.809645] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.811052] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-da86fb94-092b-4e94-9f72-77721773f6fc taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.811215] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da86fb94-092b-4e94-9f72-77721773f6fc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.811271] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da86fb94-092b-4e94-9f72-77721773f6fc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.811706] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da86fb94-092b-4e94-9f72-77721773f6fc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.811745] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da86fb94-092b-4e94-9f72-77721773f6fc',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.883155] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 768b6942-2f10-48d5-8100-f6905c1e030d in Status: SUCCESS [ 1138.883398] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.883568] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.883799] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.884041] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.884183] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.884233] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.884402] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.884489] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.884567] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.884651] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('768b6942-2f10-48d5-8100-f6905c1e030d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.895850] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.896040] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.896131] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.896332] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.896467] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.289050] env[70520]: INFO networking_nsxv3.common.synchronization [None req-dd037922-f361-4fc8-8b57-3ed883122ecc None None] Enqueued Resource ID: 788a6987-8908-496d-8306-729abfc9e299 with Priority: HIGHEST for action port [ 1139.292055] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 788a6987-8908-496d-8306-729abfc9e299 with Priority: HIGHEST for action port [ 1139.292055] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-788a6987-8908-496d-8306-729abfc9e299 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.292055] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-788a6987-8908-496d-8306-729abfc9e299" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.292055] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-788a6987-8908-496d-8306-729abfc9e299" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.292055] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-788a6987-8908-496d-8306-729abfc9e299" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.292055] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('788a6987-8908-496d-8306-729abfc9e299',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.314324] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da86fb94-092b-4e94-9f72-77721773f6fc with status ACTIVE [ 1139.314570] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.314689] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.314759] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.314975] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.315089] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.315261] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.315367] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.315431] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.315588] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.315663] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.315835] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.315953] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.315991] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.316794] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.316920] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.316993] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da86fb94-092b-4e94-9f72-77721773f6fc is going to be updated. [ 1139.318323] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.318549] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.318769] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.351353] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.351517] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.351625] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.351852] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.351988] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.352213] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da86fb94-092b-4e94-9f72-77721773f6fc" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.389921] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-768b6942-2f10-48d5-8100-f6905c1e030d taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.389921] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.389921] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.389921] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.389921] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.389921] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.389921] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.389921] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.389921] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.389921] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.392272] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-768b6942-2f10-48d5-8100-f6905c1e030d taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.395541] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.395541] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.395541] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.395541] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.395541] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.395541] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.395541] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.395541] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.395541] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.395541] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('768b6942-2f10-48d5-8100-f6905c1e030d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.400093] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.794406] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 788a6987-8908-496d-8306-729abfc9e299 [ 1139.794652] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.794800] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.794900] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.795252] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.795333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.795437] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:788a6987-8908-496d-8306-729abfc9e299 already deleted. [ 1139.795575] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-788a6987-8908-496d-8306-729abfc9e299" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.824037] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.899464] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 768b6942-2f10-48d5-8100-f6905c1e030d: rpc.has_security_group_logging(os_id): False [ 1139.904569] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.919485] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.919595] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.919676] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.919985] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.921103] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.921103] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.921103] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.921103] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.921103] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.921103] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.921103] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.921103] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.921103] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.921103] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.921814] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.921814] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.921814] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.921814] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.921814] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.921814] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.921814] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 768b6942-2f10-48d5-8100-f6905c1e030d is going to be created. [ 1139.984301] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.984513] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.984565] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.984750] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.984964] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.000608] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 768b6942-2f10-48d5-8100-f6905c1e030d in Status: IN_PROGRESS for 2s [ 1140.224826] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b635a150-2303-4a51-9fa7-6a4633e2197a in Status: SUCCESS [ 1140.225779] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.227922] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.227922] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.227922] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.227922] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.227922] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.227922] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.227922] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.227922] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.227922] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.327764] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.328076] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.328076] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.328252] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.328343] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.328517] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a is going to be updated. [ 1140.381369] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.381369] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.381369] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.381530] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.381530] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.392720] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: IN_PROGRESS for 2s [ 1140.406450] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1140.406450] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1140.729947] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b635a150-2303-4a51-9fa7-6a4633e2197a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.730278] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.730368] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.731088] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.731088] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.731330] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.731330] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.731496] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.731641] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.731809] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.732019] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b635a150-2303-4a51-9fa7-6a4633e2197a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.732157] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.732223] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.732407] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.732582] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.732766] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.733241] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.733920] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.733920] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.733920] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.733920] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.236059] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b635a150-2303-4a51-9fa7-6a4633e2197a: rpc.has_security_group_logging(os_id): False [ 1141.266908] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.267085] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.267155] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.267366] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.267451] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.267650] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.267740] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.267798] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.267977] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.268073] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.268276] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.268363] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.268439] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.268603] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.268694] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.268878] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.268970] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.269671] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.269956] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.270257] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.270257] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b635a150-2303-4a51-9fa7-6a4633e2197a is going to be updated. [ 1141.380046] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.380046] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.380046] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.380046] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.380046] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.399516] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b635a150-2303-4a51-9fa7-6a4633e2197a in Status: IN_PROGRESS for 2s [ 1141.805281] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.805281] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.805409] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.805581] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.820997] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1141.821392] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.822963] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1141.873579] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.873808] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.873808] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.876021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.889561] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.890546] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1141.890641] env[70520]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70520) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1141.890715] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1141.969876] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.970088] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.970160] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.970399] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.972997] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.973428] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1142.015920] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 768b6942-2f10-48d5-8100-f6905c1e030d in Status: SUCCESS [ 1142.016154] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.085108] env[70520]: INFO networking_nsxv3.common.synchronization [None req-f4592034-f5f0-450a-a8ca-aba9c7801967 None None] Enqueued Resource ID: ac763a06-987c-48a5-9610-8d147807cb3b with Priority: HIGHEST for action port [ 1142.085108] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac763a06-987c-48a5-9610-8d147807cb3b with Priority: HIGHEST for action port [ 1142.085917] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac763a06-987c-48a5-9610-8d147807cb3b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.086201] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac763a06-987c-48a5-9610-8d147807cb3b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.086364] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac763a06-987c-48a5-9610-8d147807cb3b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.086777] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac763a06-987c-48a5-9610-8d147807cb3b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.087042] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac763a06-987c-48a5-9610-8d147807cb3b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.097442] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.097691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.097773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.097989] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.098376] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.098754] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1142.206814] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.206814] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.206814] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.207159] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.207438] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.207895] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:45. [ 1142.208238] env[70520]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'c5c80f62-f996-4458-84d5-6fced2d8e47d', 'ada31481-82b9-4792-af47-296d5fe27a9f', '858fdcda-30cd-409f-85f7-656e8a82042b', '6d7f9020-5060-4aaf-81f1-cec3849eacc0', '58197438-6dcb-404e-a8c1-aeacc2454958', 'b635a150-2303-4a51-9fa7-6a4633e2197a', '4686572e-3137-42e1-a568-9db02b6e5e1c', 'e1706c97-ada0-42a9-ae16-d557fcd51adb', '468bd631-24dc-43d9-8a0f-93dcf753e208', 'e2732d4c-390c-4309-8596-f408bd1b4ecf', '2449c3c4-f89c-449c-97e2-c22d5d72dbee', '58550c6c-a09f-469c-981b-0404b38bdf5d', '1d3e2e95-1306-419d-a0f9-f4e048bfb7db', '0775b802-20d8-4210-ad0d-b621a7b66c62', '80751702-3cad-4ef3-af48-e8bd866c7e7f', 'a238fd65-d476-4f25-8c29-5e2babcc5026', 'd217c04a-3f61-40d6-89c2-a60cc7eb772a', '768b6942-2f10-48d5-8100-f6905c1e030d', 'd77f36dd-6e19-41b5-98f9-4bafae832400', '8a927ecd-fa02-4905-9c80-5ef71a14a848', '8af5cf3c-e464-4241-82ec-9fc46dc5ae9f', '9526fc0a-60e6-4c7c-a0b5-b827fe4038aa', '3cc3c352-f711-4ecc-9064-0883727ce3ad', '1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3', '75f6513e-43fa-4780-ac9e-9333cfa1c6a9', '7be95060-a5a7-451a-a570-3386da846ca4', 'da040ed9-9da1-43c9-b672-1e4e957ffa6c', '7c9dafc4-e7ff-4514-ba35-e91b76e57256', '653491db-2944-4ea2-bef7-8e2800a4b41b', 'd202bbfa-42d6-4633-985f-b1007599bbf2', '89cb747a-f330-415b-bfd6-17be7d8807fb', '4cfd4659-cc60-4e40-83b3-09f036d8f58c', 'bc967d33-6d28-4dd5-98c4-22ac5cda2d2e', '9d478320-7685-43e1-8bec-cd33229a3a3f', '817afef8-2b10-4463-a0ad-bc691b622f6f', 'ed51a6f5-8537-40e6-9b09-ff216cb9a61d', '4c90693a-14b7-438f-84ec-4b2ae33515d7', 'f4e36438-996a-4d8f-adfb-5a87b2e7bd82', 'a23aa860-12db-4b07-ac46-cf4709db7164', '22824640-0730-4b9a-a9ef-9014ef216bc4', '8b22ab11-3a43-4e3c-a9ac-8ee49b487341', '0fc21783-a665-46f8-bdde-7d13f7923e03', '17f391db-1908-4d0d-afa1-a1da6f6944f6', '5d999f7b-50c9-40ee-b3b1-31ead407224c', '049500dd-1e0c-481a-b7e8-f7bc25741086'} {{(pid=70520) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1142.208238] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1142.233104] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.233345] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.233438] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.233682] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.233764] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.233901] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1142.233972] env[70520]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70520) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1142.234238] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1142.323561] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.323788] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.323788] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.323989] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.328655] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.329077] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1142.329167] env[70520]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70520) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1142.329248] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1142.329332] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1142.329414] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/45 resources of Type:Security Group Rules [ 1142.329511] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c5c80f62-f996-4458-84d5-6fced2d8e47d with Priority: HIGH for action security_group_rules [ 1142.329594] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ada31481-82b9-4792-af47-296d5fe27a9f with Priority: HIGH for action security_group_rules [ 1142.329681] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 858fdcda-30cd-409f-85f7-656e8a82042b with Priority: HIGH for action security_group_rules [ 1142.329743] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGH for action security_group_rules [ 1142.329818] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 58197438-6dcb-404e-a8c1-aeacc2454958 with Priority: HIGH for action security_group_rules [ 1142.329875] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b635a150-2303-4a51-9fa7-6a4633e2197a with Priority: HIGH for action security_group_rules [ 1142.329938] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4686572e-3137-42e1-a568-9db02b6e5e1c with Priority: HIGH for action security_group_rules [ 1142.330011] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e1706c97-ada0-42a9-ae16-d557fcd51adb with Priority: HIGH for action security_group_rules [ 1142.330089] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGH for action security_group_rules [ 1142.330149] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e2732d4c-390c-4309-8596-f408bd1b4ecf with Priority: HIGH for action security_group_rules [ 1142.330224] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee with Priority: HIGH for action security_group_rules [ 1142.330284] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 58550c6c-a09f-469c-981b-0404b38bdf5d with Priority: HIGH for action security_group_rules [ 1142.330340] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGH for action security_group_rules [ 1142.330388] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0775b802-20d8-4210-ad0d-b621a7b66c62 with Priority: HIGH for action security_group_rules [ 1142.330450] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGH for action security_group_rules [ 1142.330511] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGH for action security_group_rules [ 1142.330573] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGH for action security_group_rules [ 1142.330646] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 768b6942-2f10-48d5-8100-f6905c1e030d with Priority: HIGH for action security_group_rules [ 1142.330700] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d77f36dd-6e19-41b5-98f9-4bafae832400 with Priority: HIGH for action security_group_rules [ 1142.330767] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGH for action security_group_rules [ 1142.330888] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.410105] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: SUCCESS [ 1142.410521] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.410674] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.410891] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.411337] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.411337] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.411337] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.415022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.415022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.415022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.415022] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.589857] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac763a06-987c-48a5-9610-8d147807cb3b [ 1142.590269] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.590490] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.590604] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.590905] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.591086] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.591266] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac763a06-987c-48a5-9610-8d147807cb3b already deleted. [ 1142.591418] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac763a06-987c-48a5-9610-8d147807cb3b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.913772] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.914072] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.914072] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.914299] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.914471] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.914590] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.914624] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.914805] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.914934] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.914968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.915725] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.915725] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.915725] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.915725] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.915725] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.915725] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.915725] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.916072] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.916072] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.916072] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.916072] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.997654] env[70520]: INFO networking_nsxv3.common.synchronization [req-716bea58-be62-47b2-9b44-21de2059b4b6 req-5255cc33-b2b6-43b0-861a-51168c3c6bd0 tempest-AttachVolumeNegativeTest-1224878754 tempest-AttachVolumeNegativeTest-1224878754-project-member] Enqueued Resource ID: 9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb with Priority: HIGHEST for action security_group_members [ 1142.997654] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb with Priority: HIGHEST for action security_group_members [ 1142.997654] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c80f62-f996-4458-84d5-6fced2d8e47d with Priority: HIGH for action security_group_rules [ 1143.000747] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858fdcda-30cd-409f-85f7-656e8a82042b with Priority: HIGH for action security_group_rules [ 1143.001044] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4686572e-3137-42e1-a568-9db02b6e5e1c with Priority: HIGH for action security_group_rules [ 1143.001238] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGH for action security_group_rules [ 1143.001348] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGH for action security_group_rules [ 1143.001447] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d77f36dd-6e19-41b5-98f9-4bafae832400 with Priority: HIGH for action security_group_rules [ 1143.001543] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 768b6942-2f10-48d5-8100-f6905c1e030d with Priority: HIGH for action security_group_rules [ 1143.001637] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGH for action security_group_rules [ 1143.001727] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0775b802-20d8-4210-ad0d-b621a7b66c62 with Priority: HIGH for action security_group_rules [ 1143.001815] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a238fd65-d476-4f25-8c29-5e2babcc5026 with Priority: HIGH for action security_group_rules [ 1143.001902] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db with Priority: HIGH for action security_group_rules [ 1143.001988] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58550c6c-a09f-469c-981b-0404b38bdf5d with Priority: HIGH for action security_group_rules [ 1143.002090] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee with Priority: HIGH for action security_group_rules [ 1143.002181] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2732d4c-390c-4309-8596-f408bd1b4ecf with Priority: HIGH for action security_group_rules [ 1143.002267] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGH for action security_group_rules [ 1143.002349] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b635a150-2303-4a51-9fa7-6a4633e2197a with Priority: HIGH for action security_group_rules [ 1143.002434] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1706c97-ada0-42a9-ae16-d557fcd51adb with Priority: HIGH for action security_group_rules [ 1143.002520] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58197438-6dcb-404e-a8c1-aeacc2454958 with Priority: HIGH for action security_group_rules [ 1143.002607] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ada31481-82b9-4792-af47-296d5fe27a9f with Priority: HIGH for action security_group_rules [ 1143.002693] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGH for action security_group_rules [ 1143.004235] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.004408] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.004485] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.004858] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.005107] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.005267] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.005336] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.005519] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.005600] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.005699] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.007015] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5c80f62-f996-4458-84d5-6fced2d8e47d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.007155] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.007218] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.007361] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.007434] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5c80f62-f996-4458-84d5-6fced2d8e47d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.009442] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-858fdcda-30cd-409f-85f7-656e8a82042b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.009611] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.009684] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.009921] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.010048] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('858fdcda-30cd-409f-85f7-656e8a82042b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.012854] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4686572e-3137-42e1-a568-9db02b6e5e1c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.013097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.013197] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.013657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.013657] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4686572e-3137-42e1-a568-9db02b6e5e1c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.016302] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.016302] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.016302] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.016302] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.016302] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.017166] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.020699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.020699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.020699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.020699] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.020699] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d77f36dd-6e19-41b5-98f9-4bafae832400 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.020699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.020699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.020699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.020699] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d77f36dd-6e19-41b5-98f9-4bafae832400',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.021563] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-768b6942-2f10-48d5-8100-f6905c1e030d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.021726] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.021821] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.022157] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.022267] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('768b6942-2f10-48d5-8100-f6905c1e030d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.023775] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.023870] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.024118] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0775b802-20d8-4210-ad0d-b621a7b66c62 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.024466] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.024466] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.024598] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.024693] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0775b802-20d8-4210-ad0d-b621a7b66c62',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.026046] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a238fd65-d476-4f25-8c29-5e2babcc5026 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.026203] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.026297] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.026585] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.026703] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a238fd65-d476-4f25-8c29-5e2babcc5026',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.028255] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d3e2e95-1306-419d-a0f9-f4e048bfb7db taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.028456] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.031088] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.031088] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.031088] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d3e2e95-1306-419d-a0f9-f4e048bfb7db',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.031088] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58550c6c-a09f-469c-981b-0404b38bdf5d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.031088] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.031088] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.031088] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.031088] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58550c6c-a09f-469c-981b-0404b38bdf5d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.031765] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.031934] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.032686] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.032686] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.032686] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2449c3c4-f89c-449c-97e2-c22d5d72dbee',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.033643] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2732d4c-390c-4309-8596-f408bd1b4ecf taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.033839] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.033888] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.034173] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.034311] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2732d4c-390c-4309-8596-f408bd1b4ecf',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.035476] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.035637] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.035772] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.035994] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.036079] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.037229] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b635a150-2303-4a51-9fa7-6a4633e2197a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.037377] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.037772] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1706c97-ada0-42a9-ae16-d557fcd51adb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.037940] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.037940] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.038174] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.038694] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1706c97-ada0-42a9-ae16-d557fcd51adb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.039573] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58197438-6dcb-404e-a8c1-aeacc2454958 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.039717] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.039827] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.040061] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.040178] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58197438-6dcb-404e-a8c1-aeacc2454958',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.044773] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ada31481-82b9-4792-af47-296d5fe27a9f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.045042] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.045150] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.045513] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.045513] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ada31481-82b9-4792-af47-296d5fe27a9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.047081] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.047171] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.047207] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.047462] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.047591] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.080218] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.080218] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.080218] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.080218] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.084517] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.084704] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.114882] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.114882] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58550c6c-a09f-469c-981b-0404b38bdf5d is going to be deleted. [ 1143.115806] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.115806] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.143673] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.143673] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4686572e-3137-42e1-a568-9db02b6e5e1c is going to be deleted. [ 1143.212775] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.213089] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.213089] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.213301] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.213421] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.213609] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58550c6c-a09f-469c-981b-0404b38bdf5d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.243612] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.243849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.243849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.244068] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.244168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.244455] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4686572e-3137-42e1-a568-9db02b6e5e1c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.421519] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d217c04a-3f61-40d6-89c2-a60cc7eb772a: rpc.has_security_group_logging(os_id): False [ 1143.435069] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b635a150-2303-4a51-9fa7-6a4633e2197a in Status: SUCCESS [ 1143.435304] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.435489] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.435742] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.435827] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.441075] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.441201] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.441609] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.441609] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.463321] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.463745] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.463917] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.464087] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.464381] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.464500] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.464683] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.464808] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.464885] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.465099] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.465212] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.465549] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.465549] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.465671] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.466023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.466023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.466023] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a is going to be updated. [ 1143.550403] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.550499] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.550707] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.551116] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.551269] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.553243] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.553368] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.553436] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.553630] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.553825] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.553934] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.554208] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.554378] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.554465] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.554587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.554681] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.555629] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.555741] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.555827] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.555987] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.557587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.557808] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.557926] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.558010] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.558227] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.558327] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.558506] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb already deleted. [ 1143.558596] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.559921] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-858fdcda-30cd-409f-85f7-656e8a82042b taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.560050] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.560169] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.560249] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.560395] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.560580] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.560580] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.560699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.560809] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.560915] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.561014] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('858fdcda-30cd-409f-85f7-656e8a82042b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.570971] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-768b6942-2f10-48d5-8100-f6905c1e030d taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.572034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.572161] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.572738] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.572995] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.573174] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.573281] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.573579] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.573690] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.573841] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.573958] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('768b6942-2f10-48d5-8100-f6905c1e030d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.582331] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.582526] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.582617] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.582915] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.583105] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.583236] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.583303] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.583497] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.583608] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.583697] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.583795] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.586241] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d7f9020-5060-4aaf-81f1-cec3849eacc0 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.586487] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.586487] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.589050] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.589050] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.589050] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.589050] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.589050] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.589050] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.589050] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.589050] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.601756] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-768b6942-2f10-48d5-8100-f6905c1e030d taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.601917] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.602028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.602284] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.602890] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.602890] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.602890] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.602890] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.602890] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.603169] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.603169] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-768b6942-2f10-48d5-8100-f6905c1e030d taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.603236] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.603294] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.603431] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.603577] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.603677] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.603994] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.603994] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.603994] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.604114] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.604152] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('768b6942-2f10-48d5-8100-f6905c1e030d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.623995] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: IN_PROGRESS for 2s [ 1143.647248] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.647498] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.647609] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.647872] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.653990] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.654149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.666395] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.666395] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.666395] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.666395] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.676780] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.677131] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.678930] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.678930] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.679864] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.680270] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.680989] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.681177] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.681842] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.681965] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.683867] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.683956] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.685715] env[70520]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1143.685715] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.685715] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.701684] env[70520]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1143.701961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.702586] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f is going to be deleted. [ 1143.703430] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.704510] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.735747] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.735747] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5c80f62-f996-4458-84d5-6fced2d8e47d is going to be deleted. [ 1143.737037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.737300] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.785252] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.785389] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d3e2e95-1306-419d-a0f9-f4e048bfb7db is going to be deleted. [ 1143.786680] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.786909] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.790778] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.790894] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.808110] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-811 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.808110] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-811" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.808110] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-811" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.808110] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-811" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.808110] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.808110] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.808110] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.808110] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.810040] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.810040] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1143.810040] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1143.810290] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1143.810290] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1143.810361] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1143.810426] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1143.810582] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1143.824796] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.824942] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d77f36dd-6e19-41b5-98f9-4bafae832400 is going to be deleted. [ 1143.825892] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.826126] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.840553] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.840685] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.847244] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1143.847477] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1143.847648] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1143.847874] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-811" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.848325] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-53ec7930-770a-4035-a838-180573cae575 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.848609] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-53ec7930-770a-4035-a838-180573cae575" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.848769] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-53ec7930-770a-4035-a838-180573cae575" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.849207] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-53ec7930-770a-4035-a838-180573cae575" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.849388] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53ec7930-770a-4035-a838-180573cae575',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.866903] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.867072] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2732d4c-390c-4309-8596-f408bd1b4ecf is going to be deleted. [ 1143.868159] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.868420] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.939147] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b635a150-2303-4a51-9fa7-6a4633e2197a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.939300] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.939388] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.939923] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.939923] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.940116] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.940116] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.940268] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.940348] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.940530] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.940628] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.972878] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.973088] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.992846] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.994029] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a238fd65-d476-4f25-8c29-5e2babcc5026 is going to be deleted. [ 1143.994347] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.994629] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.996578] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.996761] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.071378] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('858fdcda-30cd-409f-85f7-656e8a82042b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.072903] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.073093] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.073860] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.073860] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.073860] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.073860] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.073860] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.074138] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.074138] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.074252] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.074366] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.074466] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.074533] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.074701] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.075360] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.075360] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.075360] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.075360] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.075360] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.075862] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.075862] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.083571] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.083571] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.087142] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.087283] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ada31481-82b9-4792-af47-296d5fe27a9f is going to be deleted. [ 1144.090039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.090039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.101773] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.101773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.101773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.101773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.102039] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.102039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.102039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.102171] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.102256] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.102343] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.102486] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.102578] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.102637] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.102778] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.102908] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.103084] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.103084] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.103184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.103256] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.103392] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.103441] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.104923] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.110694] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 768b6942-2f10-48d5-8100-f6905c1e030d: rpc.has_security_group_logging(os_id): False [ 1144.156556] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.156709] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1706c97-ada0-42a9-ae16-d557fcd51adb is going to be deleted. [ 1144.157714] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.157950] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.179665] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.179824] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.200606] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.200606] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.201901] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.201901] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58197438-6dcb-404e-a8c1-aeacc2454958 is going to be deleted. [ 1144.202845] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.203031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.264114] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.264267] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0775b802-20d8-4210-ad0d-b621a7b66c62 is going to be deleted. [ 1144.265273] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.265545] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.305325] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.305556] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.306556] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.306742] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.352158] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.352158] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.352158] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.352435] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.352517] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.352705] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 53ec7930-770a-4035-a838-180573cae575 not found, creating... [ 1144.353016] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.353241] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.353515] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.353791] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.354090] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.354674] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.354674] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.355182] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.355456] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.355638] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.355822] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 53ec7930-770a-4035-a838-180573cae575 is going to be created. [ 1144.358847] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.358999] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2449c3c4-f89c-449c-97e2-c22d5d72dbee is going to be deleted. [ 1144.360024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.360267] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.360385] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.360539] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.360728] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.360987] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.361127] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.361447] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5c80f62-f996-4458-84d5-6fced2d8e47d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.361822] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.362035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.362202] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.362361] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d77f36dd-6e19-41b5-98f9-4bafae832400" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.363211] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.364250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.364250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.364250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.364250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.364250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58197438-6dcb-404e-a8c1-aeacc2454958" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.364250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.364250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.364250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.364250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d3e2e95-1306-419d-a0f9-f4e048bfb7db" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.364250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.364594] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.364594] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.364677] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2732d4c-390c-4309-8596-f408bd1b4ecf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.364851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.365018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.365158] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.365321] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a238fd65-d476-4f25-8c29-5e2babcc5026" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.365465] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.365631] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.415052] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.415052] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.419508] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.419508] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.419508] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.420118] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.420118] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.420296] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-53ec7930-770a-4035-a838-180573cae575" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.439528] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.439528] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.439883] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.439883] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.439967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.440112] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.440404] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.440554] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.440605] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.441880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.441880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.441880] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.441880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.441880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.441880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.441880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.441880] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 768b6942-2f10-48d5-8100-f6905c1e030d is going to be updated. [ 1144.443061] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.443229] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.443331] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.443518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1706c97-ada0-42a9-ae16-d557fcd51adb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.443567] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.443710] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.444469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.444469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ada31481-82b9-4792-af47-296d5fe27a9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.444469] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b635a150-2303-4a51-9fa7-6a4633e2197a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.444469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.444469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.444469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.444805] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.444805] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.444879] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.445019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.445168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.445395] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.445462] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b635a150-2303-4a51-9fa7-6a4633e2197a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.445527] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.445588] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.445732] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.445874] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.445979] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.446033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.446167] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.446644] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.446644] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.446644] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.447291] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.447457] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.447539] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.447657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0775b802-20d8-4210-ad0d-b621a7b66c62" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.576640] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.577068] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.577264] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.577579] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.577780] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.578042] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2449c3c4-f89c-449c-97e2-c22d5d72dbee" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.578388] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 858fdcda-30cd-409f-85f7-656e8a82042b: rpc.has_security_group_logging(os_id): False [ 1144.580114] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 468bd631-24dc-43d9-8a0f-93dcf753e208: rpc.has_security_group_logging(os_id): False [ 1144.585496] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.585496] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.585496] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.585496] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.585496] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.606808] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d7f9020-5060-4aaf-81f1-cec3849eacc0: rpc.has_security_group_logging(os_id): False [ 1144.608079] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a927ecd-fa02-4905-9c80-5ef71a14a848: rpc.has_security_group_logging(os_id): False [ 1144.610634] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.610829] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.610900] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.611131] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.623753] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 768b6942-2f10-48d5-8100-f6905c1e030d in Status: IN_PROGRESS for 2s [ 1144.629642] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.629642] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.647623] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.647747] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.649840] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.649840] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.650141] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.650267] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.650355] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.650421] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.650643] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.650745] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.650955] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.651150] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.651150] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.651306] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.654570] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.654570] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.654570] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.654570] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.654570] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.654570] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.654570] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 is going to be updated. [ 1144.654570] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.654570] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.741709] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.742435] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.742435] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.742435] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.742654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.743232] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.743232] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 858fdcda-30cd-409f-85f7-656e8a82042b is going to be updated. [ 1144.745231] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.745517] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.819795] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.820128] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.820360] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.820426] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.820686] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.820804] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.821032] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.821128] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.821193] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.821358] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.821439] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.821654] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.821739] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.822445] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.822445] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.822445] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.822445] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be updated. [ 1144.823430] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.824196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.825965] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.826077] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.848198] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.848744] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.848929] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.849075] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.849374] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.849517] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.849652] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 is going to be updated. [ 1144.851857] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.852175] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.852405] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.868172] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.868331] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.868401] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.868728] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.868881] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.882485] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: IN_PROGRESS for 2s [ 1144.907167] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 858fdcda-30cd-409f-85f7-656e8a82042b in Status: IN_PROGRESS for 2s [ 1144.949277] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b635a150-2303-4a51-9fa7-6a4633e2197a: rpc.has_security_group_logging(os_id): False [ 1144.959036] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.959219] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.959291] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.959483] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.959624] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.962241] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.962387] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.962440] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.962624] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.962765] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.977223] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: IN_PROGRESS for 2s [ 1144.992787] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: IN_PROGRESS for 2s [ 1145.004930] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.005121] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.005193] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.005449] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.045145] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.045500] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.045651] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.045718] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.045936] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.046108] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.046399] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.046540] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.046594] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.046776] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.046848] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.047083] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.047239] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.047239] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.047354] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.047460] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.047548] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b635a150-2303-4a51-9fa7-6a4633e2197a is going to be updated. [ 1145.195666] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.197342] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.198877] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.198877] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.198877] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.238228] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b635a150-2303-4a51-9fa7-6a4633e2197a in Status: IN_PROGRESS for 2s [ 1145.255746] env[70520]: INFO networking_nsxv3.common.synchronization [req-716bea58-be62-47b2-9b44-21de2059b4b6 req-fbe6efd6-901e-4709-aafe-3df621858434 service nova] Enqueued Resource ID: 9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb with Priority: HIGHEST for action security_group_rules [ 1145.255746] env[70520]: INFO networking_nsxv3.common.synchronization [req-716bea58-be62-47b2-9b44-21de2059b4b6 req-fbe6efd6-901e-4709-aafe-3df621858434 service nova] Enqueued Resource ID: 9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb with Priority: HIGHEST for action security_group_members [ 1145.255746] env[70520]: INFO networking_nsxv3.common.synchronization [req-716bea58-be62-47b2-9b44-21de2059b4b6 req-fbe6efd6-901e-4709-aafe-3df621858434 service nova] Enqueued Resource ID: 53ec7930-770a-4035-a838-180573cae575 with Priority: HIGHEST for action port [ 1145.255746] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb with Priority: HIGHEST for action security_group_rules [ 1145.255746] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb with Priority: HIGHEST for action security_group_members [ 1145.255746] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53ec7930-770a-4035-a838-180573cae575 with Priority: HIGHEST for action port [ 1145.255746] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.255746] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.256349] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.256391] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.256636] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.261342] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.261342] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.261342] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.261342] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.261342] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.261342] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.261342] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.261342] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.261342] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.261342] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.265021] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-53ec7930-770a-4035-a838-180573cae575 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.265021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53ec7930-770a-4035-a838-180573cae575" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.265021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53ec7930-770a-4035-a838-180573cae575" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.265021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53ec7930-770a-4035-a838-180573cae575" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.265021] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53ec7930-770a-4035-a838-180573cae575',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.642819] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: SUCCESS [ 1145.643224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.643383] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.643683] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.643799] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.766645] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.766900] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.767211] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.768550] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 53ec7930-770a-4035-a838-180573cae575 with status ACTIVE [ 1145.768857] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.771137] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.771275] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.771774] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.771774] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.772065] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.772261] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.772261] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.772479] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.772533] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.772884] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.773044] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.773044] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.773192] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.773244] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.773350] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 53ec7930-770a-4035-a838-180573cae575 is going to be updated. [ 1145.805078] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.805313] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.805313] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.805523] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.805662] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.805880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53ec7930-770a-4035-a838-180573cae575" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.147145] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.147318] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.147394] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.147614] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.147789] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.147947] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.147947] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.148111] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.148195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.148284] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.148374] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.276146] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.642723] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 768b6942-2f10-48d5-8100-f6905c1e030d in Status: SUCCESS [ 1146.642723] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.651681] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.652035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.652035] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.652188] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.652368] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.652490] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.652523] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.652760] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.652861] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.652955] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.653204] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.653361] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.653460] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.653688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.653920] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.654095] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.654206] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.654736] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.654818] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.654974] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.655144] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.777554] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.777730] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.777793] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.779085] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.779085] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.779085] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb is going to be created. [ 1146.804223] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.804487] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.804487] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.805285] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.805285] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.816945] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb in Status: UNINITIALIZED for 2s [ 1146.894526] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: SUCCESS [ 1146.895425] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.916712] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 858fdcda-30cd-409f-85f7-656e8a82042b in Status: SUCCESS [ 1146.916940] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.994835] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: SUCCESS [ 1146.995214] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.004114] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: SUCCESS [ 1147.004334] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.157390] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d217c04a-3f61-40d6-89c2-a60cc7eb772a: rpc.has_security_group_logging(os_id): False [ 1147.184667] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.184844] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.184953] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.185418] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.185418] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.185539] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.185589] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.185619] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.185791] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.185850] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.186063] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.186224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.186224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.186371] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.186434] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.187111] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.187242] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.187293] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.187426] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.188026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.188026] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a is going to be updated. [ 1147.257162] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b635a150-2303-4a51-9fa7-6a4633e2197a in Status: SUCCESS [ 1147.257754] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.258277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.258617] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.258784] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.275249] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.275483] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.275569] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.275844] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.276029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.294797] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: IN_PROGRESS for 2s [ 1147.563613] env[70520]: INFO networking_nsxv3.common.synchronization [req-5dffef43-f889-4ce9-bf0b-3f70049c38eb req-6ac1c682-3047-45f2-be1c-0015631ebf44 tempest-ServerRescueNegativeTestJSON-1807205180 tempest-ServerRescueNegativeTestJSON-1807205180-project-member] Enqueued Resource ID: e0706cbe-8591-4697-88fe-710ca5564421 with Priority: HIGHEST for action security_group_members [ 1147.564213] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0706cbe-8591-4697-88fe-710ca5564421 with Priority: HIGHEST for action security_group_members [ 1147.564949] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0706cbe-8591-4697-88fe-710ca5564421 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.565142] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.565206] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.565451] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.565645] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.565796] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.565796] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.565939] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.566032] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.566255] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0706cbe-8591-4697-88fe-710ca5564421',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.767429] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b635a150-2303-4a51-9fa7-6a4633e2197a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.767429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.767429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.767429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.767429] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.767429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.767429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.767429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.767429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.767429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.767429] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.930331] env[70520]: INFO networking_nsxv3.common.synchronization [req-fac2338d-7e02-444c-8585-ec848f37a921 req-5d1bf4c9-1f81-417b-b205-2c62346729c0 tempest-InstanceActionsNegativeTestJSON-1765654458 tempest-InstanceActionsNegativeTestJSON-1765654458-project-member] Enqueued Resource ID: 768b6942-2f10-48d5-8100-f6905c1e030d with Priority: HIGHEST for action security_group_members [ 1147.932017] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 768b6942-2f10-48d5-8100-f6905c1e030d with Priority: HIGHEST for action security_group_members [ 1147.932017] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-768b6942-2f10-48d5-8100-f6905c1e030d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.932017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.932017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.932017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.932017] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.934485] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.934772] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.935236] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.936163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.936163] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('768b6942-2f10-48d5-8100-f6905c1e030d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.043373] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-104 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.043625] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-104" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.043695] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-104" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.044100] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-104" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.044390] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.044556] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.044747] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.045723] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.045977] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.046278] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1148.046462] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1148.046717] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1148.046881] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1148.047057] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1148.047221] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1148.047431] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1148.066888] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1148.067171] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1148.067376] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1148.067591] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-104" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.067953] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-4ad5c3e5-f573-4595-a097-935f919dee6b taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.068154] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-4ad5c3e5-f573-4595-a097-935f919dee6b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.068279] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-4ad5c3e5-f573-4595-a097-935f919dee6b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.068612] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-4ad5c3e5-f573-4595-a097-935f919dee6b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.069042] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ad5c3e5-f573-4595-a097-935f919dee6b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.069695] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.069812] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.069893] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.070051] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.070133] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.070308] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.070401] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.070466] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.070598] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.070671] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.070751] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0706cbe-8591-4697-88fe-710ca5564421 already deleted. [ 1148.070829] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.270257] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b635a150-2303-4a51-9fa7-6a4633e2197a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.270524] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.270597] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.270949] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.271227] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.271390] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.271506] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.271774] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.271926] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.272092] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.272327] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b635a150-2303-4a51-9fa7-6a4633e2197a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.272483] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.272592] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.272826] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.273057] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.273206] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.273306] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.273536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.273672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.273811] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.273948] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.441523] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.441668] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.441746] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.441964] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.442068] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.442287] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.442392] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.442452] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.442607] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.442683] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.442767] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 768b6942-2f10-48d5-8100-f6905c1e030d is going to be updated. [ 1148.469016] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.469204] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.469204] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.470072] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.470072] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.477784] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 768b6942-2f10-48d5-8100-f6905c1e030d in Status: IN_PROGRESS for 2s [ 1148.572583] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.572826] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.572956] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.573536] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.573754] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.573905] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 4ad5c3e5-f573-4595-a097-935f919dee6b not found, creating... [ 1148.574412] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.574568] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.574881] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.574940] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.575077] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.575387] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.575548] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.575670] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.575888] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.576037] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.576225] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 4ad5c3e5-f573-4595-a097-935f919dee6b is going to be created. [ 1148.621172] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.621400] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.621531] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.621832] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.622084] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.622341] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-4ad5c3e5-f573-4595-a097-935f919dee6b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.779932] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b635a150-2303-4a51-9fa7-6a4633e2197a: rpc.has_security_group_logging(os_id): False [ 1148.803981] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.804218] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.804218] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.804438] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.804531] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.804732] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.804858] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.804920] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.805098] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.805175] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.805381] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.805475] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.805538] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.805696] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.805770] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.805951] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.806436] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.806560] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.806721] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.806798] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.806884] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b635a150-2303-4a51-9fa7-6a4633e2197a is going to be updated. [ 1148.833945] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb in Status: SUCCESS [ 1148.834185] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.834358] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.834574] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.834767] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.834887] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.834952] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.835124] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.835230] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.835289] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.835377] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.900995] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.901193] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.901264] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.901483] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.901625] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.923831] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b635a150-2303-4a51-9fa7-6a4633e2197a in Status: IN_PROGRESS for 2s [ 1149.308835] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: SUCCESS [ 1149.309163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.338184] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.421325] env[70520]: INFO networking_nsxv3.common.synchronization [req-5dffef43-f889-4ce9-bf0b-3f70049c38eb req-2bbb1a93-f912-4adc-b449-07cf6bfd5084 service nova] Enqueued Resource ID: e0706cbe-8591-4697-88fe-710ca5564421 with Priority: HIGHEST for action security_group_rules [ 1149.421325] env[70520]: INFO networking_nsxv3.common.synchronization [req-5dffef43-f889-4ce9-bf0b-3f70049c38eb req-2bbb1a93-f912-4adc-b449-07cf6bfd5084 service nova] Enqueued Resource ID: e0706cbe-8591-4697-88fe-710ca5564421 with Priority: HIGHEST for action security_group_members [ 1149.421325] env[70520]: INFO networking_nsxv3.common.synchronization [req-5dffef43-f889-4ce9-bf0b-3f70049c38eb req-2bbb1a93-f912-4adc-b449-07cf6bfd5084 service nova] Enqueued Resource ID: 4ad5c3e5-f573-4595-a097-935f919dee6b with Priority: HIGHEST for action port [ 1149.421325] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0706cbe-8591-4697-88fe-710ca5564421 with Priority: HIGHEST for action security_group_rules [ 1149.422458] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0706cbe-8591-4697-88fe-710ca5564421 with Priority: HIGHEST for action security_group_members [ 1149.422458] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ad5c3e5-f573-4595-a097-935f919dee6b with Priority: HIGHEST for action port [ 1149.422711] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0706cbe-8591-4697-88fe-710ca5564421 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.422881] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.422929] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.423298] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.423333] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0706cbe-8591-4697-88fe-710ca5564421',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.424429] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0706cbe-8591-4697-88fe-710ca5564421 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.424429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.424529] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.424664] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.424809] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.424902] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.424963] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.425121] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.425202] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.425296] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0706cbe-8591-4697-88fe-710ca5564421',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.426064] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ad5c3e5-f573-4595-a097-935f919dee6b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.426171] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ad5c3e5-f573-4595-a097-935f919dee6b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.426222] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ad5c3e5-f573-4595-a097-935f919dee6b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.426370] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ad5c3e5-f573-4595-a097-935f919dee6b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.426473] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ad5c3e5-f573-4595-a097-935f919dee6b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.841132] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb: rpc.has_security_group_logging(os_id): False [ 1149.860989] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.861249] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.861249] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.861557] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.861685] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.861999] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.862173] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.862308] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.862476] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.862553] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.862655] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb is going to be created. [ 1149.927812] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0706cbe-8591-4697-88fe-710ca5564421 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.928043] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.928278] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0706cbe-8591-4697-88fe-710ca5564421',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.929357] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4ad5c3e5-f573-4595-a097-935f919dee6b with status ACTIVE [ 1149.929577] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.929761] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.929874] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.930113] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.930207] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.930568] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.930728] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.930820] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.931023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.931139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.931451] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.931619] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.931714] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.931896] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.932007] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.932126] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4ad5c3e5-f573-4595-a097-935f919dee6b is going to be updated. [ 1149.936251] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.936339] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.936446] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.936695] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.936919] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.949082] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb in Status: IN_PROGRESS for 2s [ 1149.957780] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.957952] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.958064] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.958430] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.958527] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.958674] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ad5c3e5-f573-4595-a097-935f919dee6b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.434816] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0706cbe-8591-4697-88fe-710ca5564421',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.491062] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 768b6942-2f10-48d5-8100-f6905c1e030d in Status: SUCCESS [ 1150.491271] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 768b6942-2f10-48d5-8100-f6905c1e030d deletion is rescheduled due to dependency. [ 1150.491403] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.761294] env[70520]: INFO networking_nsxv3.common.synchronization [req-0ebbc139-a0c2-4c11-a4d9-84ae940b74f5 req-3f7f814f-7a76-496a-baa7-f58975d9d4fc tempest-DeleteServersTestJSON-1399047283 tempest-DeleteServersTestJSON-1399047283-project-member] Enqueued Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 1150.761861] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 1150.762173] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.762291] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.762361] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.762553] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.762701] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.762792] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.762859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.762990] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.763078] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.763174] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.937153] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.937521] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.937521] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.937595] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.937778] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.937778] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0706cbe-8591-4697-88fe-710ca5564421 is going to be created. [ 1150.939770] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b635a150-2303-4a51-9fa7-6a4633e2197a in Status: SUCCESS [ 1150.939937] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.967139] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.967139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.967139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.967139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.967139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.975815] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0706cbe-8591-4697-88fe-710ca5564421 in Status: UNINITIALIZED for 2s [ 1151.077125] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-493 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.077347] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-493" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.077497] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-493" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.077754] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-493" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.078015] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.078289] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.078435] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.078704] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.078898] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.079159] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1151.079280] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1151.079419] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1151.079536] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1151.079989] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1151.079989] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1151.079989] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1151.102684] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1151.102957] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1151.103130] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1151.103308] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-493" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.103631] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-2e32dde8-43bd-4f15-bff8-1b35cd42763b taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.103809] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-2e32dde8-43bd-4f15-bff8-1b35cd42763b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.103960] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-2e32dde8-43bd-4f15-bff8-1b35cd42763b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.104304] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-2e32dde8-43bd-4f15-bff8-1b35cd42763b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.104450] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e32dde8-43bd-4f15-bff8-1b35cd42763b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.266261] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.266422] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.266583] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.266802] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.266981] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.267262] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.267425] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.267534] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.267775] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.267938] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.268097] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f is going to be deleted. [ 1151.303252] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.303418] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.303485] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.303691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.303791] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.303954] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.607300] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.607452] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.607611] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.608037] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.608196] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.611303] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 2e32dde8-43bd-4f15-bff8-1b35cd42763b not found, creating... [ 1151.611303] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.611303] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.611303] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.611303] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.611303] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.611303] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.611303] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.611303] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.611303] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.611852] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.611852] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 2e32dde8-43bd-4f15-bff8-1b35cd42763b is going to be created. [ 1151.648837] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.649219] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.649438] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.649895] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.650248] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.650525] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-2e32dde8-43bd-4f15-bff8-1b35cd42763b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.960778] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb in Status: SUCCESS [ 1151.961146] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.038284] env[70520]: INFO networking_nsxv3.common.synchronization [req-bcc3c4ac-9e44-40a2-8868-7f945f325efc req-70563b49-bc29-4329-a335-dd57b5649ff2 tempest-ServerActionsTestOtherB-256435736 tempest-ServerActionsTestOtherB-256435736-project-member] Enqueued Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_members [ 1152.038917] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_members [ 1152.039690] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d7f9020-5060-4aaf-81f1-cec3849eacc0 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.039690] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.039690] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.039690] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.039960] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.040147] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.040255] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.040505] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.040664] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.040919] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.380668] env[70520]: INFO networking_nsxv3.common.synchronization [req-0ebbc139-a0c2-4c11-a4d9-84ae940b74f5 req-8bbea21e-c8c2-4b8d-95e9-3d30e3250dbf service nova] Enqueued Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_rules [ 1152.380849] env[70520]: INFO networking_nsxv3.common.synchronization [req-0ebbc139-a0c2-4c11-a4d9-84ae940b74f5 req-8bbea21e-c8c2-4b8d-95e9-3d30e3250dbf service nova] Enqueued Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 1152.380986] env[70520]: INFO networking_nsxv3.common.synchronization [req-0ebbc139-a0c2-4c11-a4d9-84ae940b74f5 req-8bbea21e-c8c2-4b8d-95e9-3d30e3250dbf service nova] Enqueued Resource ID: 2e32dde8-43bd-4f15-bff8-1b35cd42763b with Priority: HIGHEST for action port [ 1152.381233] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_rules [ 1152.381358] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 1152.381450] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e32dde8-43bd-4f15-bff8-1b35cd42763b with Priority: HIGHEST for action port [ 1152.382239] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.382391] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.382459] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.382665] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.382749] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.383663] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.383763] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.383830] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.384037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.384153] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.384272] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.384440] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.384525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.384609] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.384699] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.385484] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e32dde8-43bd-4f15-bff8-1b35cd42763b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.385609] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e32dde8-43bd-4f15-bff8-1b35cd42763b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.385827] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e32dde8-43bd-4f15-bff8-1b35cd42763b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.385827] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e32dde8-43bd-4f15-bff8-1b35cd42763b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.385892] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e32dde8-43bd-4f15-bff8-1b35cd42763b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.543984] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.544263] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.544303] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.544849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.544976] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.545256] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.545370] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.545436] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.545658] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.545751] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.545872] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 is going to be updated. [ 1152.581286] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.581533] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.581611] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.581840] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.582147] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.595639] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: IN_PROGRESS for 2s [ 1152.763035] env[70520]: INFO networking_nsxv3.common.synchronization [req-c027ca23-a5c4-4000-8334-6df5c6aa6c56 req-ef9f1f21-bb33-4b0b-a48b-43213a8b2910 tempest-AttachInterfacesTestJSON-1687744298 tempest-AttachInterfacesTestJSON-1687744298-project-member] Enqueued Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_members [ 1152.763607] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_members [ 1152.765107] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.765107] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.765107] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.765107] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.765107] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.765107] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.765107] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.765107] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.765107] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.765449] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.890803] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.891043] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.891114] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.891269] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e32dde8-43bd-4f15-bff8-1b35cd42763b with status ACTIVE [ 1152.891449] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.891560] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.891627] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.891886] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.892009] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.892185] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.892287] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.892364] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.892525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.892889] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.893018] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.893556] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.893556] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.893556] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.893556] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.893556] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e32dde8-43bd-4f15-bff8-1b35cd42763b is going to be updated. [ 1152.928279] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.928432] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.928526] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.928955] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.929190] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.929458] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e32dde8-43bd-4f15-bff8-1b35cd42763b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.986506] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0706cbe-8591-4697-88fe-710ca5564421 in Status: SUCCESS [ 1152.986832] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.987008] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.987248] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.988175] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.988175] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.988175] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.988175] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.988175] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.988175] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.988175] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0706cbe-8591-4697-88fe-710ca5564421',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.269237] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.299247] env[70520]: INFO networking_nsxv3.common.synchronization [req-403cd678-ebc5-4897-b6a9-75ffa632c033 req-0bf4dfd4-7d37-4fb6-8b2f-bc4940c802b0 tempest-ServerActionsV293TestJSON-1078912952 tempest-ServerActionsV293TestJSON-1078912952-project-member] Enqueued Resource ID: 75f6513e-43fa-4780-ac9e-9333cfa1c6a9 with Priority: HIGHEST for action security_group_members [ 1153.299247] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75f6513e-43fa-4780-ac9e-9333cfa1c6a9 with Priority: HIGHEST for action security_group_members [ 1153.299247] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-75f6513e-43fa-4780-ac9e-9333cfa1c6a9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.299247] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.299247] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.299247] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.299963] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.300245] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.300414] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.301657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.301657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.301657] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75f6513e-43fa-4780-ac9e-9333cfa1c6a9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.341170] env[70520]: INFO networking_nsxv3.common.synchronization [req-25e774bf-983a-4b3d-a2ef-ce94ca097b07 req-15dd882b-6803-4c7d-afdf-028929e2d5f0 tempest-ServerRescueNegativeTestJSON-1807205180 tempest-ServerRescueNegativeTestJSON-1807205180-project-member] Enqueued Resource ID: e0706cbe-8591-4697-88fe-710ca5564421 with Priority: HIGHEST for action security_group_members [ 1153.343310] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0706cbe-8591-4697-88fe-710ca5564421 with Priority: HIGHEST for action security_group_members [ 1153.343952] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0706cbe-8591-4697-88fe-710ca5564421 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.344341] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.344576] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.345715] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.345715] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.345715] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.345715] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.346788] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.347353] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.347646] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0706cbe-8591-4697-88fe-710ca5564421',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.397733] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.495462] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0706cbe-8591-4697-88fe-710ca5564421 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.495462] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.771506] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.807054] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.807339] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.807339] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.807534] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.838171] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.838171] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.838171] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.838171] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.838171] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.838171] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.838418] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75f6513e-43fa-4780-ac9e-9333cfa1c6a9 is going to be updated. [ 1153.851239] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0706cbe-8591-4697-88fe-710ca5564421',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.878177] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.878177] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.878177] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.878177] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.878177] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.888712] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75f6513e-43fa-4780-ac9e-9333cfa1c6a9 in Status: IN_PROGRESS for 2s [ 1153.899303] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.902065] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.902065] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.902065] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.902065] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.902065] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f is going to be created. [ 1153.914020] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-104 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.914020] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-104" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.914020] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-104" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.914020] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-104" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.914020] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.914020] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.914020] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.914020] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.914689] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.915038] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1153.915379] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1153.915596] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1153.915791] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1153.915994] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1153.916225] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1153.916445] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1153.956065] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1153.956065] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1153.956065] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1153.956065] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-104" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.956065] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-4c268337-0f59-4eb6-8905-aba2b128ef4f taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.956065] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-4c268337-0f59-4eb6-8905-aba2b128ef4f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.956065] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-4c268337-0f59-4eb6-8905-aba2b128ef4f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.956065] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-4c268337-0f59-4eb6-8905-aba2b128ef4f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.956065] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c268337-0f59-4eb6-8905-aba2b128ef4f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.958232] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.958542] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.958786] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.959079] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.959349] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.976786] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: UNINITIALIZED for 2s [ 1154.276906] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.277341] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.277341] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.277504] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.277614] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.277715] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a is going to be updated. [ 1154.311298] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.311552] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.311625] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.311838] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.311982] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.334091] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: IN_PROGRESS for 2s [ 1154.353607] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0706cbe-8591-4697-88fe-710ca5564421',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.464060] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.464862] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.464862] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.465546] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.465869] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.466230] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 4c268337-0f59-4eb6-8905-aba2b128ef4f not found, creating... [ 1154.467083] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.467309] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.467441] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.467740] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.468446] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.468948] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.469606] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.470163] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.470476] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.470679] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.470954] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 4c268337-0f59-4eb6-8905-aba2b128ef4f is going to be created. [ 1154.498997] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.498997] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.498997] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.498997] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.498997] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.498997] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-4c268337-0f59-4eb6-8905-aba2b128ef4f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.511913] env[70520]: INFO networking_nsxv3.common.synchronization [None req-21ae5991-b14a-41e4-b370-ef3ac644eeab tempest-AttachInterfacesTestJSON-1687744298 tempest-AttachInterfacesTestJSON-1687744298-project-member] Enqueued Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_members [ 1154.513971] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_members [ 1154.513971] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.513971] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.613192] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: SUCCESS [ 1154.613390] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 deletion is rescheduled due to dependency. [ 1154.613561] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.856557] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.856755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.856827] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.857061] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.857155] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.857256] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0706cbe-8591-4697-88fe-710ca5564421 is going to be updated. [ 1154.894198] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.894407] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.894485] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.894707] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.894855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.912736] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0706cbe-8591-4697-88fe-710ca5564421 in Status: IN_PROGRESS for 2s [ 1155.766505] env[70520]: INFO networking_nsxv3.common.synchronization [req-25e774bf-983a-4b3d-a2ef-ce94ca097b07 req-4e27d546-fbf2-4b7d-a44d-7d956fe0068d service nova] Enqueued Resource ID: e0706cbe-8591-4697-88fe-710ca5564421 with Priority: HIGHEST for action security_group_rules [ 1155.766921] env[70520]: INFO networking_nsxv3.common.synchronization [req-25e774bf-983a-4b3d-a2ef-ce94ca097b07 req-4e27d546-fbf2-4b7d-a44d-7d956fe0068d service nova] Enqueued Resource ID: e0706cbe-8591-4697-88fe-710ca5564421 with Priority: HIGHEST for action security_group_members [ 1155.768366] env[70520]: INFO networking_nsxv3.common.synchronization [req-25e774bf-983a-4b3d-a2ef-ce94ca097b07 req-4e27d546-fbf2-4b7d-a44d-7d956fe0068d service nova] Enqueued Resource ID: 4c268337-0f59-4eb6-8905-aba2b128ef4f with Priority: HIGHEST for action port [ 1155.769048] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0706cbe-8591-4697-88fe-710ca5564421 with Priority: HIGHEST for action security_group_rules [ 1155.769493] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0706cbe-8591-4697-88fe-710ca5564421 with Priority: HIGHEST for action security_group_members [ 1155.769700] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c268337-0f59-4eb6-8905-aba2b128ef4f with Priority: HIGHEST for action port [ 1155.770037] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0706cbe-8591-4697-88fe-710ca5564421 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.770165] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.770351] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0706cbe-8591-4697-88fe-710ca5564421 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.770470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.770745] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c268337-0f59-4eb6-8905-aba2b128ef4f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.771673] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c268337-0f59-4eb6-8905-aba2b128ef4f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.771771] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c268337-0f59-4eb6-8905-aba2b128ef4f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.772151] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c268337-0f59-4eb6-8905-aba2b128ef4f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.772228] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c268337-0f59-4eb6-8905-aba2b128ef4f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.900839] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75f6513e-43fa-4780-ac9e-9333cfa1c6a9 in Status: SUCCESS [ 1155.901034] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75f6513e-43fa-4780-ac9e-9333cfa1c6a9 deletion is rescheduled due to dependency. [ 1155.901150] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.988446] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: SUCCESS [ 1155.988690] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.988881] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.989206] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.989422] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.989544] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.989606] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.989791] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.989905] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.990009] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.990125] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.277645] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c268337-0f59-4eb6-8905-aba2b128ef4f with status ACTIVE [ 1156.277908] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.278079] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.278171] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.278454] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.278569] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.278806] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.278897] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.278993] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.280837] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.280837] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.280837] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.280837] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.280837] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.280837] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.280837] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.280837] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c268337-0f59-4eb6-8905-aba2b128ef4f is going to be updated. [ 1156.310242] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.310382] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.310546] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.310728] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.310887] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.311090] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c268337-0f59-4eb6-8905-aba2b128ef4f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.350214] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: SUCCESS [ 1156.350214] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.350214] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.350366] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.350475] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.350601] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.350706] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.350832] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.350915] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.351025] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.492314] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.492526] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.492618] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.492801] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.492978] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.493149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.493228] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.493749] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.493749] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.493749] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.493749] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.493935] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.493935] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.494030] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.494202] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.494256] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.494319] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.494538] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.494624] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.494710] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.494794] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.855640] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.855919] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.855998] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.856297] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.856443] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.856756] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.856919] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.857036] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.857271] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.857394] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.857529] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a is going to be updated. [ 1156.891586] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.891839] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.891905] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.892233] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.892446] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.904264] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: IN_PROGRESS for 2s [ 1156.923368] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0706cbe-8591-4697-88fe-710ca5564421 in Status: SUCCESS [ 1156.923599] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.923791] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.924058] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.924327] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.924415] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.924455] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.924578] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.924662] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.924747] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.924937] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0706cbe-8591-4697-88fe-710ca5564421 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.925055] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.925115] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.925262] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.925401] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.925495] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.925555] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.925691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.925765] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.925859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.925952] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0706cbe-8591-4697-88fe-710ca5564421',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.926828] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.926988] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.927148] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.927271] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.927341] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.927712] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.927797] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.927889] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0706cbe-8591-4697-88fe-710ca5564421',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.997537] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 80751702-3cad-4ef3-af48-e8bd866c7e7f: rpc.has_security_group_logging(os_id): False [ 1157.019540] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.019700] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.019814] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.020111] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.020284] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.020557] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.020674] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.020790] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.020968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.021545] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.021833] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.021954] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.022033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.022289] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.022376] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.022570] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.022775] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.022866] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.023044] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.023154] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.023219] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f is going to be created. [ 1157.088328] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.088510] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.088574] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.088792] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.089038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.110425] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: IN_PROGRESS for 2s [ 1157.430151] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0706cbe-8591-4697-88fe-710ca5564421: rpc.has_security_group_logging(os_id): False [ 1157.431479] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0706cbe-8591-4697-88fe-710ca5564421',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.450743] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.451178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.451338] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.451610] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.452967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.452967] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.452967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.452967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.452967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.452967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.452967] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.452967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.452967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.453350] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.453350] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.453453] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.453577] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.453641] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.453788] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.453862] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.453953] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0706cbe-8591-4697-88fe-710ca5564421 is going to be created. [ 1157.549407] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.549632] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.549756] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.549968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.553462] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.573664] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0706cbe-8591-4697-88fe-710ca5564421 in Status: IN_PROGRESS for 2s [ 1157.909007] env[70520]: INFO networking_nsxv3.common.synchronization [req-aed46e7b-2b78-4e76-9a54-da6d4c3d4b0a req-38b2f929-6812-4ef6-88c1-0b5c7f6cd5a2 tempest-AttachInterfacesTestJSON-1687744298 tempest-AttachInterfacesTestJSON-1687744298-project-member] Enqueued Resource ID: 9d478320-7685-43e1-8bec-cd33229a3a3f with Priority: HIGHEST for action security_group_members [ 1157.909910] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d478320-7685-43e1-8bec-cd33229a3a3f with Priority: HIGHEST for action security_group_members [ 1157.910374] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d478320-7685-43e1-8bec-cd33229a3a3f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.910534] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d478320-7685-43e1-8bec-cd33229a3a3f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.910621] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d478320-7685-43e1-8bec-cd33229a3a3f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.910889] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d478320-7685-43e1-8bec-cd33229a3a3f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.911114] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.911249] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.911348] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.911555] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.911664] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.911847] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d478320-7685-43e1-8bec-cd33229a3a3f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.933298] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0706cbe-8591-4697-88fe-710ca5564421',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.420909] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.421153] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.421239] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.421477] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.435841] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.436048] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.436100] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.437397] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.437585] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.437711] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0706cbe-8591-4697-88fe-710ca5564421 is going to be updated. [ 1158.443530] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.443776] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.443895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.443961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.444179] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.444261] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.444351] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d478320-7685-43e1-8bec-cd33229a3a3f is going to be updated. [ 1158.472951] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.473127] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.473199] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.473413] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.473558] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.476244] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.476363] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.476431] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.476658] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.476790] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.487088] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d478320-7685-43e1-8bec-cd33229a3a3f in Status: IN_PROGRESS for 2s [ 1158.487748] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0706cbe-8591-4697-88fe-710ca5564421 in Status: IN_PROGRESS for 2s [ 1158.917319] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: SUCCESS [ 1158.917846] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a deletion is rescheduled due to dependency. [ 1158.917846] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.041622] env[70520]: INFO networking_nsxv3.common.synchronization [req-35a4dbeb-8b8d-4f38-a839-c8f685fa28a2 req-2c961c6a-d11a-45e8-874a-615042bdbe34 tempest-ImagesTestJSON-1211196503 tempest-ImagesTestJSON-1211196503-project-member] Enqueued Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1159.041622] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1159.041622] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.041622] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.041622] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.041622] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.041622] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.041622] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.041622] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.041622] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.041622] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.041622] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.123360] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: SUCCESS [ 1159.123602] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.252142] env[70520]: INFO networking_nsxv3.common.synchronization [req-4f3a72f0-0e76-4e78-ac9a-afc94ef45a51 req-1241c014-fffa-4b77-8a5f-9b6b93b8fd11 tempest-ListServerFiltersTestJSON-1362658205 tempest-ListServerFiltersTestJSON-1362658205-project-member] Enqueued Resource ID: b635a150-2303-4a51-9fa7-6a4633e2197a with Priority: HIGHEST for action security_group_members [ 1159.255991] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b635a150-2303-4a51-9fa7-6a4633e2197a with Priority: HIGHEST for action security_group_members [ 1159.259461] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b635a150-2303-4a51-9fa7-6a4633e2197a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.259461] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.259461] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.259461] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.259461] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.259461] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.259461] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.259461] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.259461] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.259461] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.546245] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.585543] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0706cbe-8591-4697-88fe-710ca5564421 in Status: SUCCESS [ 1159.586083] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.586856] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.588177] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.588177] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0706cbe-8591-4697-88fe-710ca5564421',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.761052] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.885038] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-29 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.885265] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-29" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.885404] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-29" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.885694] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-29" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.885980] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.886165] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.886302] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.886584] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.886728] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.886969] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1159.887116] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1159.887257] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1159.887443] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1159.887527] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1159.887602] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1159.887739] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1159.910768] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1159.911110] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1159.911374] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1159.911671] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-29" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.912525] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-1dd1b833-af98-4619-a6a0-4de2b38b092a taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.912525] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-1dd1b833-af98-4619-a6a0-4de2b38b092a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.912759] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-1dd1b833-af98-4619-a6a0-4de2b38b092a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.913332] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-1dd1b833-af98-4619-a6a0-4de2b38b092a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.913594] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1dd1b833-af98-4619-a6a0-4de2b38b092a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.052059] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.097564] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0706cbe-8591-4697-88fe-710ca5564421 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.097773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.264313] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.416820] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.417155] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.417299] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.417605] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.417753] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.417917] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 1dd1b833-af98-4619-a6a0-4de2b38b092a not found, creating... [ 1160.418228] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.418408] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.418515] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.418838] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.418995] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.419343] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.419527] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.419683] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.420048] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.420048] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.420337] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 1dd1b833-af98-4619-a6a0-4de2b38b092a is going to be created. [ 1160.445766] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.446069] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.446213] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.446513] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.446792] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.447061] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-1dd1b833-af98-4619-a6a0-4de2b38b092a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.453099] env[70520]: INFO networking_nsxv3.common.synchronization [None req-581a05ae-6346-45f0-ac57-3227db55e0de None None] Enqueued Resource ID: ceb362c8-e6e3-41d9-b433-fd1081d0c6f5 with Priority: HIGHEST for action port [ 1160.457372] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceb362c8-e6e3-41d9-b433-fd1081d0c6f5 with Priority: HIGHEST for action port [ 1160.457372] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-ceb362c8-e6e3-41d9-b433-fd1081d0c6f5 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.457372] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ceb362c8-e6e3-41d9-b433-fd1081d0c6f5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.457372] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ceb362c8-e6e3-41d9-b433-fd1081d0c6f5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.457372] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ceb362c8-e6e3-41d9-b433-fd1081d0c6f5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.457372] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ceb362c8-e6e3-41d9-b433-fd1081d0c6f5',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.499475] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d478320-7685-43e1-8bec-cd33229a3a3f in Status: SUCCESS [ 1160.499652] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d478320-7685-43e1-8bec-cd33229a3a3f deletion is rescheduled due to dependency. [ 1160.499792] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d478320-7685-43e1-8bec-cd33229a3a3f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.500562] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0706cbe-8591-4697-88fe-710ca5564421 in Status: SUCCESS [ 1160.500739] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.500883] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.501172] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.501367] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.501481] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.501540] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.501693] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.501768] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.501849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.501937] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0706cbe-8591-4697-88fe-710ca5564421',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.555574] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.555848] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.555848] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.556024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.556117] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.556215] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 is going to be updated. [ 1160.593483] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.593654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.593725] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.593956] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.594135] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.605861] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: IN_PROGRESS for 2s [ 1160.771335] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.771335] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.771335] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.771335] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.771335] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.771335] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b635a150-2303-4a51-9fa7-6a4633e2197a is going to be updated. [ 1160.805960] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.805960] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.805960] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.805960] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.805960] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.818914] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b635a150-2303-4a51-9fa7-6a4633e2197a in Status: IN_PROGRESS for 2s [ 1160.961377] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ceb362c8-e6e3-41d9-b433-fd1081d0c6f5 [ 1160.961377] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.961377] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.961377] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.961377] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.961377] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.961377] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ceb362c8-e6e3-41d9-b433-fd1081d0c6f5 already deleted. [ 1160.961377] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ceb362c8-e6e3-41d9-b433-fd1081d0c6f5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.004033] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0706cbe-8591-4697-88fe-710ca5564421 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.004218] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.004291] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.004605] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.004695] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.004885] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.004885] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.004999] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.005095] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.005207] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.005358] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0706cbe-8591-4697-88fe-710ca5564421 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.005450] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.005511] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.005719] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.005793] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.005880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.005954] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.006085] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.006154] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.006233] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.006325] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0706cbe-8591-4697-88fe-710ca5564421',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.054277] env[70520]: INFO networking_nsxv3.common.synchronization [req-0266887e-97d9-4453-a59a-0172e99844fb req-9bb69839-4ebc-4544-857e-786d97e4f223 tempest-ServersTestJSON-589199853 tempest-ServersTestJSON-589199853-project-member] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1161.054277] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1161.054277] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.054277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.054277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.054277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.054277] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.054277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.054277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.054277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.054277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.054277] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.509502] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0706cbe-8591-4697-88fe-710ca5564421: rpc.has_security_group_logging(os_id): False [ 1161.511578] env[70520]: INFO networking_nsxv3.common.synchronization [req-35a4dbeb-8b8d-4f38-a839-c8f685fa28a2 req-bdd31ae8-a5b3-4139-b1db-534bfebd66f4 service nova] Enqueued Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_rules [ 1161.511578] env[70520]: INFO networking_nsxv3.common.synchronization [req-35a4dbeb-8b8d-4f38-a839-c8f685fa28a2 req-bdd31ae8-a5b3-4139-b1db-534bfebd66f4 service nova] Enqueued Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1161.511808] env[70520]: INFO networking_nsxv3.common.synchronization [req-35a4dbeb-8b8d-4f38-a839-c8f685fa28a2 req-bdd31ae8-a5b3-4139-b1db-534bfebd66f4 service nova] Enqueued Resource ID: 1dd1b833-af98-4619-a6a0-4de2b38b092a with Priority: HIGHEST for action port [ 1161.513662] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_rules [ 1161.513805] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1161.513905] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dd1b833-af98-4619-a6a0-4de2b38b092a with Priority: HIGHEST for action port [ 1161.514876] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.514876] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.514876] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.515070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.515543] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.517134] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.517247] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.517538] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-1dd1b833-af98-4619-a6a0-4de2b38b092a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.519703] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1dd1b833-af98-4619-a6a0-4de2b38b092a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.519785] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1dd1b833-af98-4619-a6a0-4de2b38b092a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.522331] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1dd1b833-af98-4619-a6a0-4de2b38b092a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.522644] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1dd1b833-af98-4619-a6a0-4de2b38b092a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.542259] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.542259] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.542259] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.542259] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.542259] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.542259] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.542259] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.542259] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.542259] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.542259] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.542259] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.542259] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.543439] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.543834] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.544105] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.544427] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.544688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.544846] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.545154] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.545336] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.545511] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0706cbe-8591-4697-88fe-710ca5564421 is going to be updated. [ 1161.556851] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.662342] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.662591] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.662675] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.664084] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.664084] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.687750] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0706cbe-8591-4697-88fe-710ca5564421 in Status: IN_PROGRESS for 2s [ 1161.761722] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-831 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.762297] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-831" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.762470] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-831" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.762756] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-831" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.763068] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.763262] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.763839] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.764438] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.764494] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.764714] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1161.764862] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1161.764986] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1161.766338] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1161.766617] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1161.766687] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1161.767015] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1161.802053] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1161.802263] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1161.802405] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1161.802590] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-831" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.803150] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-9b8e430d-bf23-4ff9-a883-e941e5ae796c taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.803554] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-9b8e430d-bf23-4ff9-a883-e941e5ae796c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.803731] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-9b8e430d-bf23-4ff9-a883-e941e5ae796c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.804157] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-9b8e430d-bf23-4ff9-a883-e941e5ae796c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.804340] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b8e430d-bf23-4ff9-a883-e941e5ae796c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.025334] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.025458] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.026831] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1dd1b833-af98-4619-a6a0-4de2b38b092a with status ACTIVE [ 1162.027091] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.027640] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.027640] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.027640] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.027640] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.027884] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.028020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.028127] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.028287] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.028364] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.028571] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.028665] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.028767] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.029102] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.029102] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.029102] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1dd1b833-af98-4619-a6a0-4de2b38b092a is going to be updated. [ 1162.055025] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.055420] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.055420] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.055503] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.056057] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.056057] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1dd1b833-af98-4619-a6a0-4de2b38b092a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.059483] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.306818] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.307095] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.307229] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.307508] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.307656] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.307819] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 9b8e430d-bf23-4ff9-a883-e941e5ae796c not found, creating... [ 1162.308097] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.308262] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.308381] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.308601] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.308789] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.309105] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.309250] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.309369] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.309576] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.309736] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.309891] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 9b8e430d-bf23-4ff9-a883-e941e5ae796c is going to be created. [ 1162.333827] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.334146] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.334212] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.334439] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.334899] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.335211] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-9b8e430d-bf23-4ff9-a883-e941e5ae796c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.565570] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.565744] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.565840] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.566101] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.566196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.566297] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be updated. [ 1162.598404] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.599415] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.599415] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.599415] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.599415] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.611380] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: IN_PROGRESS for 2s [ 1162.619039] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: SUCCESS [ 1162.619039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.619039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.619039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.619039] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.619039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.619039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.619039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.619039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.619039] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.827883] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b635a150-2303-4a51-9fa7-6a4633e2197a in Status: SUCCESS [ 1162.828144] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.042953] env[70520]: INFO networking_nsxv3.common.synchronization [None req-6154e930-f0ad-452f-8455-425fd68cae82 None None] Enqueued Resource ID: a90ece62-70be-4a79-ac04-3053b36f4c94 with Priority: HIGHEST for action port [ 1163.043238] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a90ece62-70be-4a79-ac04-3053b36f4c94 with Priority: HIGHEST for action port [ 1163.043801] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-a90ece62-70be-4a79-ac04-3053b36f4c94 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.043924] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a90ece62-70be-4a79-ac04-3053b36f4c94" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.043992] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a90ece62-70be-4a79-ac04-3053b36f4c94" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.044261] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a90ece62-70be-4a79-ac04-3053b36f4c94" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.044345] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a90ece62-70be-4a79-ac04-3053b36f4c94',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.121759] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.166335] env[70520]: INFO networking_nsxv3.common.synchronization [req-0266887e-97d9-4453-a59a-0172e99844fb req-a905c2ee-aeae-4c66-ae68-7e39fc51b12b service nova] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_rules [ 1163.166335] env[70520]: INFO networking_nsxv3.common.synchronization [req-0266887e-97d9-4453-a59a-0172e99844fb req-a905c2ee-aeae-4c66-ae68-7e39fc51b12b service nova] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1163.166335] env[70520]: INFO networking_nsxv3.common.synchronization [req-0266887e-97d9-4453-a59a-0172e99844fb req-a905c2ee-aeae-4c66-ae68-7e39fc51b12b service nova] Enqueued Resource ID: 9b8e430d-bf23-4ff9-a883-e941e5ae796c with Priority: HIGHEST for action port [ 1163.166335] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_rules [ 1163.166335] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1163.166335] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b8e430d-bf23-4ff9-a883-e941e5ae796c with Priority: HIGHEST for action port [ 1163.167580] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.168359] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.168916] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.170846] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.170846] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.171748] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.172276] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.172500] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b8e430d-bf23-4ff9-a883-e941e5ae796c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.173838] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b8e430d-bf23-4ff9-a883-e941e5ae796c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.173838] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b8e430d-bf23-4ff9-a883-e941e5ae796c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.173838] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b8e430d-bf23-4ff9-a883-e941e5ae796c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.173838] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b8e430d-bf23-4ff9-a883-e941e5ae796c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.552016] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a90ece62-70be-4a79-ac04-3053b36f4c94 [ 1163.552291] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.552433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.552512] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.552880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.553023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.553099] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a90ece62-70be-4a79-ac04-3053b36f4c94 already deleted. [ 1163.553195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a90ece62-70be-4a79-ac04-3053b36f4c94" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.622893] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.676016] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.676227] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.676440] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b8e430d-bf23-4ff9-a883-e941e5ae796c with status ACTIVE [ 1163.676744] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.677968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.677968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.677968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.677968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.677968] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.677968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.677968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.678347] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.678347] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.678833] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.678833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.678833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.679172] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.679241] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.679478] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b8e430d-bf23-4ff9-a883-e941e5ae796c is going to be updated. [ 1163.714148] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.714148] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.714148] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.714310] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.714471] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.714569] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b8e430d-bf23-4ff9-a883-e941e5ae796c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.715430] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0706cbe-8591-4697-88fe-710ca5564421 in Status: SUCCESS [ 1163.715620] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.125894] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.126193] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.126193] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.126295] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.126328] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.126609] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 is going to be updated. [ 1164.159806] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.160032] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.160032] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.160321] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.160490] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.171255] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: IN_PROGRESS for 2s [ 1164.643341] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: SUCCESS [ 1164.643601] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.643685] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.643906] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.644115] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.644234] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.644299] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.644451] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.644534] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.644767] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.148182] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.652893] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.155867] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.156169] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.156169] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.156491] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.156600] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.156778] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be updated. [ 1166.183303] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: SUCCESS [ 1166.183604] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.184696] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.184696] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.184853] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.185012] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.185120] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.185326] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.185434] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.185554] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.185673] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.198462] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.198462] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.198462] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.198462] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.198783] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.210870] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: IN_PROGRESS for 2s [ 1166.688647] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.688919] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.692162] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.692162] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.692162] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.692162] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.692162] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.692162] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.692162] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.692162] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.692162] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.692162] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.692162] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.692162] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.692162] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.692162] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.692162] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.692162] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.692162] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.692162] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.692781] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.193699] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 468bd631-24dc-43d9-8a0f-93dcf753e208: rpc.has_security_group_logging(os_id): False [ 1167.218971] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.219254] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.219400] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.219650] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.219744] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.219996] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.220174] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.220265] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.220433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.220532] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.220761] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.220841] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.220908] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.221074] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.221149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.221343] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.221454] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.221516] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.221746] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.221746] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.221877] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 is going to be updated. [ 1167.454102] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.454289] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.454362] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.454543] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.454686] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.467902] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: IN_PROGRESS for 2s [ 1168.167932] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1168.168123] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1168.221015] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: SUCCESS [ 1168.221395] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.221438] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.221644] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.221852] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.221968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.222170] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.222427] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.222567] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.222669] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.222763] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.725338] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.725523] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.725597] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.725819] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.726016] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.726138] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.726205] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.726377] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.727718] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.727921] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.728216] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.728340] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.728408] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.728585] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.728755] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.728874] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.728924] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.729109] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.729192] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.729277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.729365] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.232583] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a927ecd-fa02-4905-9c80-5ef71a14a848: rpc.has_security_group_logging(os_id): False [ 1169.261877] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.262059] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.262105] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.262321] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.262414] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.262660] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.262793] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.262898] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.263086] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.263222] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.263428] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.263621] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.263712] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.263880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.263956] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.264153] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.264248] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.264309] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.264448] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.264523] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.264613] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be updated. [ 1169.336492] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.336492] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.336492] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.336953] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.336999] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.359370] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: IN_PROGRESS for 2s [ 1169.500022] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: SUCCESS [ 1169.500428] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.630099] env[70520]: INFO networking_nsxv3.common.synchronization [None req-02a9ebf3-51d2-41fa-a7f8-b13f116ea24b tempest-AttachInterfacesTestJSON-1687744298 tempest-AttachInterfacesTestJSON-1687744298-project-member] Enqueued Resource ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a with Priority: HIGHEST for action security_group_rules [ 1170.630717] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a with Priority: HIGHEST for action security_group_rules [ 1170.631022] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dcd9459-fa31-46b3-b003-f31c0576d07a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.631228] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.631228] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.632616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.632616] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dcd9459-fa31-46b3-b003-f31c0576d07a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.786664] env[70520]: INFO networking_nsxv3.common.synchronization [None req-0bda4dd8-26c5-40c5-8d70-adca8dbcb29d tempest-AttachInterfacesTestJSON-1687744298 tempest-AttachInterfacesTestJSON-1687744298-project-member] Enqueued Resource ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a with Priority: HIGHEST for action security_group_rules [ 1170.787505] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a with Priority: HIGHEST for action security_group_rules [ 1170.791423] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dcd9459-fa31-46b3-b003-f31c0576d07a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.791423] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.156620] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.157064] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.157256] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.157564] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.157752] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.157937] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a already deleted. [ 1171.158132] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.158380] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.158725] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.158931] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dcd9459-fa31-46b3-b003-f31c0576d07a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.376606] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: SUCCESS [ 1171.376941] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.683641] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.684039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.684039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.684110] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.684212] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.684263] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a already deleted. [ 1171.684319] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.009174] env[70520]: INFO networking_nsxv3.common.synchronization [req-3e89041a-11c9-4b49-8600-fc96516f5df7 req-66cde856-62da-40b4-950a-5168391b61da tempest-ServerPasswordTestJSON-1338888747 tempest-ServerPasswordTestJSON-1338888747-project-member] Enqueued Resource ID: 76407410-ab83-45d5-8a78-5480e0efc519 with Priority: HIGHEST for action security_group_members [ 1175.009675] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76407410-ab83-45d5-8a78-5480e0efc519 with Priority: HIGHEST for action security_group_members [ 1175.009988] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-76407410-ab83-45d5-8a78-5480e0efc519 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.010121] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.010180] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.010433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.010589] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.010686] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.010744] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.010897] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.010979] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.011084] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76407410-ab83-45d5-8a78-5480e0efc519',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.512998] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.513236] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.513312] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.513538] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.513628] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.513834] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.513990] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.514084] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.514240] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.514318] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.514403] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76407410-ab83-45d5-8a78-5480e0efc519 already deleted. [ 1175.514480] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.701742] env[70520]: INFO networking_nsxv3.common.synchronization [req-e07698bf-b5a4-4aa8-8604-5ae6d484eb4e req-cc5dcf25-8489-4264-8561-ccafb3d0f841 tempest-ListServerFiltersTestJSON-1362658205 tempest-ListServerFiltersTestJSON-1362658205-project-member] Enqueued Resource ID: b635a150-2303-4a51-9fa7-6a4633e2197a with Priority: HIGHEST for action security_group_members [ 1175.703308] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b635a150-2303-4a51-9fa7-6a4633e2197a with Priority: HIGHEST for action security_group_members [ 1175.703882] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b635a150-2303-4a51-9fa7-6a4633e2197a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.704834] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.705135] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.705429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.705698] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.705989] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.706217] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.706456] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.706620] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.711290] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.818613] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-161 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.818902] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-161" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.819039] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-161" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.819368] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-161" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.819635] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.819798] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.819932] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.820259] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.820425] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.820663] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1175.820784] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1175.820921] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1175.821050] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1175.821198] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1175.821292] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1175.821434] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1175.843754] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1175.843754] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1175.843754] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1175.844055] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-161" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.844122] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-0db91ad1-9de4-4997-bc94-5e64ea3aa38a taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.844341] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-0db91ad1-9de4-4997-bc94-5e64ea3aa38a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.844469] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-0db91ad1-9de4-4997-bc94-5e64ea3aa38a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.844871] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-0db91ad1-9de4-4997-bc94-5e64ea3aa38a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.845033] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0db91ad1-9de4-4997-bc94-5e64ea3aa38a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.212514] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.352216] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.352216] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.352216] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.352216] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.352216] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.352216] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 0db91ad1-9de4-4997-bc94-5e64ea3aa38a not found, creating... [ 1176.352216] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.352216] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.352216] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.352216] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.352216] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.352709] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.352709] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.353033] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.353472] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.353775] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.354080] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 0db91ad1-9de4-4997-bc94-5e64ea3aa38a is going to be created. [ 1176.378487] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.378700] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.378932] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.379351] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.380037] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.380037] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-0db91ad1-9de4-4997-bc94-5e64ea3aa38a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.717245] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.120429] env[70520]: INFO networking_nsxv3.common.synchronization [req-3e89041a-11c9-4b49-8600-fc96516f5df7 req-9fc9249b-21d3-4967-b0fe-21579c586055 service nova] Enqueued Resource ID: 76407410-ab83-45d5-8a78-5480e0efc519 with Priority: HIGHEST for action security_group_rules [ 1177.120613] env[70520]: INFO networking_nsxv3.common.synchronization [req-3e89041a-11c9-4b49-8600-fc96516f5df7 req-9fc9249b-21d3-4967-b0fe-21579c586055 service nova] Enqueued Resource ID: 76407410-ab83-45d5-8a78-5480e0efc519 with Priority: HIGHEST for action security_group_members [ 1177.120832] env[70520]: INFO networking_nsxv3.common.synchronization [req-3e89041a-11c9-4b49-8600-fc96516f5df7 req-9fc9249b-21d3-4967-b0fe-21579c586055 service nova] Enqueued Resource ID: 0db91ad1-9de4-4997-bc94-5e64ea3aa38a with Priority: HIGHEST for action port [ 1177.120981] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76407410-ab83-45d5-8a78-5480e0efc519 with Priority: HIGHEST for action security_group_rules [ 1177.121117] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76407410-ab83-45d5-8a78-5480e0efc519 with Priority: HIGHEST for action security_group_members [ 1177.121215] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0db91ad1-9de4-4997-bc94-5e64ea3aa38a with Priority: HIGHEST for action port [ 1177.121752] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76407410-ab83-45d5-8a78-5480e0efc519 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.121872] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.121952] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.122349] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.122437] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76407410-ab83-45d5-8a78-5480e0efc519',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.123304] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-76407410-ab83-45d5-8a78-5480e0efc519 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.123362] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.123423] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.123589] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.123728] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.123821] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.123880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.124027] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.124151] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.124187] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76407410-ab83-45d5-8a78-5480e0efc519',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.125251] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-0db91ad1-9de4-4997-bc94-5e64ea3aa38a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.125323] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0db91ad1-9de4-4997-bc94-5e64ea3aa38a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.125411] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0db91ad1-9de4-4997-bc94-5e64ea3aa38a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.125545] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0db91ad1-9de4-4997-bc94-5e64ea3aa38a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.125613] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0db91ad1-9de4-4997-bc94-5e64ea3aa38a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.219487] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.219899] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.219899] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.219899] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.220261] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.220261] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b635a150-2303-4a51-9fa7-6a4633e2197a is going to be updated. [ 1177.258073] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.258214] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.258331] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.258468] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.258636] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.269247] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b635a150-2303-4a51-9fa7-6a4633e2197a in Status: IN_PROGRESS for 2s [ 1177.628391] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-76407410-ab83-45d5-8a78-5480e0efc519 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.628604] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.628650] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76407410-ab83-45d5-8a78-5480e0efc519',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.629652] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0db91ad1-9de4-4997-bc94-5e64ea3aa38a with status ACTIVE [ 1177.629780] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.630375] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.630375] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.630375] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.630375] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.630375] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.630668] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.630668] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.630668] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.630751] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.630881] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.630964] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.631153] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.631354] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.631428] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.631526] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0db91ad1-9de4-4997-bc94-5e64ea3aa38a is going to be updated. [ 1177.657222] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.657665] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.657665] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.657665] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.657828] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.657961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0db91ad1-9de4-4997-bc94-5e64ea3aa38a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.133704] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76407410-ab83-45d5-8a78-5480e0efc519',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.636440] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.637631] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.637631] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.637631] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.637781] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.637781] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76407410-ab83-45d5-8a78-5480e0efc519 is going to be created. [ 1178.662980] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.662980] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.662980] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.662980] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.662980] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.672280] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76407410-ab83-45d5-8a78-5480e0efc519 in Status: UNINITIALIZED for 2s [ 1179.280262] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b635a150-2303-4a51-9fa7-6a4633e2197a in Status: SUCCESS [ 1179.280494] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.988151] env[70520]: INFO networking_nsxv3.common.synchronization [req-bbc3860e-de8d-4d3f-982f-5dee36e8234f req-1f59f3b2-5c02-4f51-8d97-7b680e981748 tempest-ServerActionsTestOtherB-256435736 tempest-ServerActionsTestOtherB-256435736-project-member] Enqueued Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_members [ 1179.989164] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_members [ 1179.989164] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d7f9020-5060-4aaf-81f1-cec3849eacc0 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.989332] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.989368] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.989568] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.989746] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.989866] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.989964] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.990170] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.990298] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.990407] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.454343] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-453 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.454648] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-453" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.454798] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-453" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.455500] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-453" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.455859] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.456055] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.456241] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.456502] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.456650] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.456892] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1180.457036] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1180.457160] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1180.457274] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1180.457390] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1180.457503] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1180.457666] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1180.477456] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1180.477630] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1180.477782] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1180.477933] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-453" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.478293] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-bfd19d7e-0d09-4f06-b1c9-31f6bc523646 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.478526] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-bfd19d7e-0d09-4f06-b1c9-31f6bc523646" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.478656] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-bfd19d7e-0d09-4f06-b1c9-31f6bc523646" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.479028] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-bfd19d7e-0d09-4f06-b1c9-31f6bc523646" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.479187] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfd19d7e-0d09-4f06-b1c9-31f6bc523646',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.493285] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.493285] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.493473] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.493509] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.493588] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.493776] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.493874] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.493931] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.494080] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.494279] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.494279] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 is going to be updated. [ 1180.529161] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.529372] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.529419] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.529632] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.529777] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.543980] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: IN_PROGRESS for 2s [ 1180.684785] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76407410-ab83-45d5-8a78-5480e0efc519 in Status: SUCCESS [ 1180.685039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.685343] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.685565] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.685762] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.685886] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.685958] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.686126] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.686208] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.686292] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.686510] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76407410-ab83-45d5-8a78-5480e0efc519',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.981361] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.981602] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.981732] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.982029] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.982185] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.982343] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port bfd19d7e-0d09-4f06-b1c9-31f6bc523646 not found, creating... [ 1180.982609] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.982767] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.982885] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.983125] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.983265] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.983592] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.983707] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.983815] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.984117] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.984231] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.984488] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: bfd19d7e-0d09-4f06-b1c9-31f6bc523646 is going to be created. [ 1181.004683] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.004683] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.005051] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.005051] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.005298] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.005535] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-bfd19d7e-0d09-4f06-b1c9-31f6bc523646" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.189273] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-76407410-ab83-45d5-8a78-5480e0efc519 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.189499] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.189499] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.189717] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.189996] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.190224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.190297] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.190492] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.190592] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.190686] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.190839] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-76407410-ab83-45d5-8a78-5480e0efc519 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.190936] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.190998] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.191160] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.191339] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.191429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.191494] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.191633] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.191724] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.191836] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.191929] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76407410-ab83-45d5-8a78-5480e0efc519',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.499017] env[70520]: INFO networking_nsxv3.common.synchronization [req-4ce55dae-b492-4cb3-91b7-6ee0406a3d52 req-2a27de28-2b36-4144-9668-bd9d5d8ff7c8 tempest-ImagesTestJSON-1211196503 tempest-ImagesTestJSON-1211196503-project-member] Enqueued Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1181.499562] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1181.499865] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.500149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.500262] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.500421] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.500581] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.500679] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.500733] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.500906] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.500958] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.501045] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.693602] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76407410-ab83-45d5-8a78-5480e0efc519: rpc.has_security_group_logging(os_id): False [ 1181.712250] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.712481] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.712544] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.712789] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.712907] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.713204] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.713342] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.713429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.713622] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.713722] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.713948] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.714085] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.714180] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.714359] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.714455] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.714693] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.714813] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.714896] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.715111] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.715181] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.715291] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76407410-ab83-45d5-8a78-5480e0efc519 is going to be created. [ 1181.779518] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.779678] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.780052] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.780052] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.780262] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.793891] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76407410-ab83-45d5-8a78-5480e0efc519 in Status: IN_PROGRESS for 2s [ 1182.004998] env[70520]: INFO networking_nsxv3.common.synchronization [req-bbc3860e-de8d-4d3f-982f-5dee36e8234f req-70620461-ca94-4bfb-a22e-5aa1a206f949 service nova] Enqueued Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_rules [ 1182.005284] env[70520]: INFO networking_nsxv3.common.synchronization [req-bbc3860e-de8d-4d3f-982f-5dee36e8234f req-70620461-ca94-4bfb-a22e-5aa1a206f949 service nova] Enqueued Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_members [ 1182.005284] env[70520]: INFO networking_nsxv3.common.synchronization [req-bbc3860e-de8d-4d3f-982f-5dee36e8234f req-70620461-ca94-4bfb-a22e-5aa1a206f949 service nova] Enqueued Resource ID: bfd19d7e-0d09-4f06-b1c9-31f6bc523646 with Priority: HIGHEST for action port [ 1182.006628] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.006845] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_rules [ 1182.006935] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_members [ 1182.007164] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfd19d7e-0d09-4f06-b1c9-31f6bc523646 with Priority: HIGHEST for action port [ 1182.007998] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.007998] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.008145] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.008322] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.008414] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.009365] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d7f9020-5060-4aaf-81f1-cec3849eacc0 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.010915] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.011203] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfd19d7e-0d09-4f06-b1c9-31f6bc523646 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.011335] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfd19d7e-0d09-4f06-b1c9-31f6bc523646" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.011416] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfd19d7e-0d09-4f06-b1c9-31f6bc523646" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.013554] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfd19d7e-0d09-4f06-b1c9-31f6bc523646" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.013663] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfd19d7e-0d09-4f06-b1c9-31f6bc523646',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.507732] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.515342] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d7f9020-5060-4aaf-81f1-cec3849eacc0 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.515526] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.517327] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bfd19d7e-0d09-4f06-b1c9-31f6bc523646 with status ACTIVE [ 1182.517525] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.517809] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.517932] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.518156] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.518248] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.518426] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.518526] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.518584] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.518770] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.518803] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.519028] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.519241] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.519241] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.519325] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.519399] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.519481] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bfd19d7e-0d09-4f06-b1c9-31f6bc523646 is going to be updated. [ 1182.542707] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.542878] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.542917] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.543140] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.543275] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.543441] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfd19d7e-0d09-4f06-b1c9-31f6bc523646" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.555965] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: SUCCESS [ 1182.556277] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 deletion is rescheduled due to dependency. [ 1182.556277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.556398] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.556604] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.556781] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.556894] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.556956] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.557133] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.557238] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.557379] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.012674] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.013048] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.013048] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.013241] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.013275] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.013376] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 is going to be updated. [ 1183.043776] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.043930] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.043992] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.044228] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.044461] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.054156] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: IN_PROGRESS for 2s [ 1183.059751] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.562495] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.807371] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76407410-ab83-45d5-8a78-5480e0efc519 in Status: SUCCESS [ 1183.807371] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.068274] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.068274] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.068274] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.068274] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.068274] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.068274] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 is going to be updated. [ 1184.097791] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.099279] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.099279] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.099279] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.099279] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.108584] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: IN_PROGRESS for 2s [ 1185.070204] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: SUCCESS [ 1185.070662] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.989577] env[70520]: INFO networking_nsxv3.common.synchronization [req-8aba27ad-921c-49ee-95e6-2e3c442740e0 req-a87974fd-84a4-42d0-9389-94d81b993ad7 tempest-ServersTestJSON-589199853 tempest-ServersTestJSON-589199853-project-member] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1185.990183] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1185.990509] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.990633] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.990700] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.990898] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.994160] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.994318] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.994379] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.996330] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.996330] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.996330] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.118815] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: SUCCESS [ 1186.119217] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.119728] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.119939] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.120185] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.121124] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.121124] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.121124] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.121124] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.121124] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.121124] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.371802] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-831 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.372088] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-831" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.372224] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-831" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.372494] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-831" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.372754] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.372910] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.373040] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.373263] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.373407] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.373609] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1186.373725] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1186.373836] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1186.373945] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1186.374066] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1186.374179] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1186.374312] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1186.394390] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1186.394572] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1186.394724] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1186.395686] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-831" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.395686] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-1bf047ea-c953-4b93-a4e5-9d696994c7d2 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.395686] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-1bf047ea-c953-4b93-a4e5-9d696994c7d2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.395686] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-1bf047ea-c953-4b93-a4e5-9d696994c7d2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.395995] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-1bf047ea-c953-4b93-a4e5-9d696994c7d2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.395995] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bf047ea-c953-4b93-a4e5-9d696994c7d2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.499247] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.623344] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.898940] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.899261] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.899459] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.899842] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.900138] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.900284] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 1bf047ea-c953-4b93-a4e5-9d696994c7d2 not found, creating... [ 1186.900969] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.900969] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.900969] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.901381] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.901443] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.901806] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.902021] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.902184] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.902448] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.902620] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.902945] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 1bf047ea-c953-4b93-a4e5-9d696994c7d2 is going to be created. [ 1186.927491] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.927718] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.928335] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.928335] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.928497] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.928910] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-1bf047ea-c953-4b93-a4e5-9d696994c7d2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.999935] env[70520]: INFO networking_nsxv3.common.synchronization [req-a7c5904c-a269-4d8c-89e8-eaf6d69c7f6a req-a697c2fe-1cf9-4a44-99d3-5d3d75d38353 tempest-ServerActionsTestJSON-420425725 tempest-ServerActionsTestJSON-420425725-project-member] Enqueued Resource ID: 4c90693a-14b7-438f-84ec-4b2ae33515d7 with Priority: HIGHEST for action security_group_members [ 1187.000602] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c90693a-14b7-438f-84ec-4b2ae33515d7 with Priority: HIGHEST for action security_group_members [ 1187.000925] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c90693a-14b7-438f-84ec-4b2ae33515d7 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.001161] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c90693a-14b7-438f-84ec-4b2ae33515d7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.001208] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c90693a-14b7-438f-84ec-4b2ae33515d7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.001437] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c90693a-14b7-438f-84ec-4b2ae33515d7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.001612] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.001669] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.001731] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.001886] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.001956] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.002061] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c90693a-14b7-438f-84ec-4b2ae33515d7',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.003051] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.128126] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d7f9020-5060-4aaf-81f1-cec3849eacc0: rpc.has_security_group_logging(os_id): False [ 1187.155038] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.155301] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.155301] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.155544] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.155651] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.155822] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.155937] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.156023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.156154] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.156247] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.156330] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 is going to be updated. [ 1187.256186] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.256186] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.256186] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.256186] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.256186] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.274318] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: IN_PROGRESS for 2s [ 1187.505410] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.505590] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.505654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.505888] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.507178] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.507312] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.507385] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.507553] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.507636] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.507771] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be updated. [ 1187.540370] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.540878] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.540878] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.540878] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.541090] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.541178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.541266] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c90693a-14b7-438f-84ec-4b2ae33515d7 is going to be updated. [ 1187.543978] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.543978] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.543978] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.544174] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.544266] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.555484] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: IN_PROGRESS for 2s [ 1187.576858] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.577115] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.577213] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.577458] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.577621] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.586958] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c90693a-14b7-438f-84ec-4b2ae33515d7 in Status: IN_PROGRESS for 2s [ 1187.892968] env[70520]: INFO networking_nsxv3.common.synchronization [req-8aba27ad-921c-49ee-95e6-2e3c442740e0 req-0daf03c5-83f6-448c-9040-92fceed0a111 service nova] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_rules [ 1187.893172] env[70520]: INFO networking_nsxv3.common.synchronization [req-8aba27ad-921c-49ee-95e6-2e3c442740e0 req-0daf03c5-83f6-448c-9040-92fceed0a111 service nova] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1187.893313] env[70520]: INFO networking_nsxv3.common.synchronization [req-8aba27ad-921c-49ee-95e6-2e3c442740e0 req-0daf03c5-83f6-448c-9040-92fceed0a111 service nova] Enqueued Resource ID: 1bf047ea-c953-4b93-a4e5-9d696994c7d2 with Priority: HIGHEST for action port [ 1187.893559] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_rules [ 1187.893675] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1187.893768] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bf047ea-c953-4b93-a4e5-9d696994c7d2 with Priority: HIGHEST for action port [ 1187.894341] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.894453] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.894524] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.894720] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.894799] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.896041] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.896041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.896244] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-1bf047ea-c953-4b93-a4e5-9d696994c7d2 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.896387] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1bf047ea-c953-4b93-a4e5-9d696994c7d2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.896478] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1bf047ea-c953-4b93-a4e5-9d696994c7d2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.896687] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1bf047ea-c953-4b93-a4e5-9d696994c7d2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.896796] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bf047ea-c953-4b93-a4e5-9d696994c7d2',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.223169] env[70520]: INFO networking_nsxv3.common.synchronization [req-ebbc6f65-abdf-4986-b41a-0f115febec8f req-5c5d3b77-c09f-4c53-bd57-011c6efd951d tempest-ServersV294TestFqdnHostnames-201987379 tempest-ServersV294TestFqdnHostnames-201987379-project-member] Enqueued Resource ID: 858fdcda-30cd-409f-85f7-656e8a82042b with Priority: HIGHEST for action security_group_members [ 1188.223169] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858fdcda-30cd-409f-85f7-656e8a82042b with Priority: HIGHEST for action security_group_members [ 1188.223475] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-858fdcda-30cd-409f-85f7-656e8a82042b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.223475] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.223577] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.224368] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.224368] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.224368] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.224368] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.224368] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.225361] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.225482] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('858fdcda-30cd-409f-85f7-656e8a82042b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.398871] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.402022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.402022] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1bf047ea-c953-4b93-a4e5-9d696994c7d2 with status ACTIVE [ 1188.402022] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.402022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.402022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.402022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.402022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.402022] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.402022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.402022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.402022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.402022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.402022] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.402022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.402022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.402022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.402022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.402622] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1bf047ea-c953-4b93-a4e5-9d696994c7d2 is going to be updated. [ 1188.412067] env[70520]: INFO networking_nsxv3.common.synchronization [req-16816043-eadf-4868-9874-cba514369022 req-baac82bb-cbbd-49bf-9d86-b4138ed88825 tempest-ServerPasswordTestJSON-1338888747 tempest-ServerPasswordTestJSON-1338888747-project-member] Enqueued Resource ID: 76407410-ab83-45d5-8a78-5480e0efc519 with Priority: HIGHEST for action security_group_members [ 1188.413101] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76407410-ab83-45d5-8a78-5480e0efc519 with Priority: HIGHEST for action security_group_members [ 1188.413765] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-76407410-ab83-45d5-8a78-5480e0efc519 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.413880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.413943] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.414148] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.414293] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.414406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.414472] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.414616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.414693] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.414780] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76407410-ab83-45d5-8a78-5480e0efc519',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.434829] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.434954] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.435028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.435974] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.435974] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.435974] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1bf047ea-c953-4b93-a4e5-9d696994c7d2" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.665679] env[70520]: INFO networking_nsxv3.common.synchronization [req-45f656bf-0120-45f2-a853-c4b033598a25 req-2c9f3018-7f6d-4f8b-894d-928f20e000ba tempest-AttachInterfacesTestJSON-1687744298 tempest-AttachInterfacesTestJSON-1687744298-project-member] Enqueued Resource ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a with Priority: HIGHEST for action security_group_members [ 1188.666364] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a with Priority: HIGHEST for action security_group_members [ 1188.666701] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dcd9459-fa31-46b3-b003-f31c0576d07a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.666835] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.666887] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.667834] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.668057] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.668173] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.668334] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.671056] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.671717] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.671841] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dcd9459-fa31-46b3-b003-f31c0576d07a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.729337] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.729581] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.729646] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.729825] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.729933] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.730218] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.730353] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.730470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.730671] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.730758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.730850] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 858fdcda-30cd-409f-85f7-656e8a82042b is going to be updated. [ 1188.759756] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.759991] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.759991] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.760290] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.760415] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.770076] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 858fdcda-30cd-409f-85f7-656e8a82042b in Status: IN_PROGRESS for 2s [ 1188.918525] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.918705] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.918705] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.918916] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.919018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.919255] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.919355] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.919416] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.919571] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.919646] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.919731] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76407410-ab83-45d5-8a78-5480e0efc519 is going to be updated. [ 1188.965685] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.965916] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.965916] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.966424] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.966424] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.977286] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76407410-ab83-45d5-8a78-5480e0efc519 in Status: IN_PROGRESS for 2s [ 1189.133708] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-631 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.137022] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.137022] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.137022] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.137022] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.137022] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.137022] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.137022] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.137022] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.137022] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1189.137022] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1189.137022] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1189.137022] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1189.137022] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1189.137022] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1189.137022] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1189.160613] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1189.160838] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1189.161231] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1189.161524] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.162396] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-21573174-8add-46d6-93ef-d2a024fb8919 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.162396] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-21573174-8add-46d6-93ef-d2a024fb8919" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.162396] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-21573174-8add-46d6-93ef-d2a024fb8919" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.162736] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-21573174-8add-46d6-93ef-d2a024fb8919" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.163078] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21573174-8add-46d6-93ef-d2a024fb8919',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.175421] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.175421] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.175421] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.175421] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.175421] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.175421] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.175421] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.175421] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.175421] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.175421] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.175421] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a already deleted. [ 1189.175421] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.290304] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: SUCCESS [ 1189.290304] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.566570] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: SUCCESS [ 1189.566851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.567138] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.567467] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.567733] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.567883] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.567956] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.568143] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.568209] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.568307] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.599779] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c90693a-14b7-438f-84ec-4b2ae33515d7 in Status: SUCCESS [ 1189.599779] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c90693a-14b7-438f-84ec-4b2ae33515d7 deletion is rescheduled due to dependency. [ 1189.599854] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c90693a-14b7-438f-84ec-4b2ae33515d7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.665408] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.665647] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.665778] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.666086] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.666241] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.666402] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 21573174-8add-46d6-93ef-d2a024fb8919 not found, creating... [ 1189.666684] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.666847] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.666987] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.667301] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.667480] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.667813] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.668012] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.668150] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.668386] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.668529] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.668677] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 21573174-8add-46d6-93ef-d2a024fb8919 is going to be created. [ 1189.692693] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.693094] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.693260] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.693661] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.694018] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.694261] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-21573174-8add-46d6-93ef-d2a024fb8919" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.071139] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.574294] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.613904] env[70520]: INFO networking_nsxv3.common.synchronization [req-586cc296-590c-41c2-8057-6231bf4ccaf3 req-5dc53242-94be-4add-82d0-8e94e8ce90e4 tempest-ListServerFiltersTestJSON-1362658205 tempest-ListServerFiltersTestJSON-1362658205-project-member] Enqueued Resource ID: b635a150-2303-4a51-9fa7-6a4633e2197a with Priority: HIGHEST for action security_group_members [ 1190.613904] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b635a150-2303-4a51-9fa7-6a4633e2197a with Priority: HIGHEST for action security_group_members [ 1190.613904] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b635a150-2303-4a51-9fa7-6a4633e2197a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.613904] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.613904] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.613904] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.613904] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.614332] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.614332] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.614332] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.614332] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.614445] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.780082] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 858fdcda-30cd-409f-85f7-656e8a82042b in Status: SUCCESS [ 1190.780300] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 858fdcda-30cd-409f-85f7-656e8a82042b deletion is rescheduled due to dependency. [ 1190.780418] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.988759] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76407410-ab83-45d5-8a78-5480e0efc519 in Status: SUCCESS [ 1190.988959] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76407410-ab83-45d5-8a78-5480e0efc519 deletion is rescheduled due to dependency. [ 1190.989022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.012355] env[70520]: INFO networking_nsxv3.common.synchronization [req-45f656bf-0120-45f2-a853-c4b033598a25 req-f21fc21d-a7cc-414e-a1c4-449c0de1af7a service nova] Enqueued Resource ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a with Priority: HIGHEST for action security_group_rules [ 1191.012539] env[70520]: INFO networking_nsxv3.common.synchronization [req-45f656bf-0120-45f2-a853-c4b033598a25 req-f21fc21d-a7cc-414e-a1c4-449c0de1af7a service nova] Enqueued Resource ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a with Priority: HIGHEST for action security_group_members [ 1191.012679] env[70520]: INFO networking_nsxv3.common.synchronization [req-45f656bf-0120-45f2-a853-c4b033598a25 req-f21fc21d-a7cc-414e-a1c4-449c0de1af7a service nova] Enqueued Resource ID: 21573174-8add-46d6-93ef-d2a024fb8919 with Priority: HIGHEST for action port [ 1191.014995] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a with Priority: HIGHEST for action security_group_rules [ 1191.015683] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a with Priority: HIGHEST for action security_group_members [ 1191.015683] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21573174-8add-46d6-93ef-d2a024fb8919 with Priority: HIGHEST for action port [ 1191.015818] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dcd9459-fa31-46b3-b003-f31c0576d07a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.015935] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.016008] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.018459] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.019171] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dcd9459-fa31-46b3-b003-f31c0576d07a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.019441] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dcd9459-fa31-46b3-b003-f31c0576d07a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.019559] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.023026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.023026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.023026] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.023026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.023026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.023026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.023026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.023026] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dcd9459-fa31-46b3-b003-f31c0576d07a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.023026] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-21573174-8add-46d6-93ef-d2a024fb8919 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.023026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21573174-8add-46d6-93ef-d2a024fb8919" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.023026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21573174-8add-46d6-93ef-d2a024fb8919" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.023700] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21573174-8add-46d6-93ef-d2a024fb8919" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.023700] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21573174-8add-46d6-93ef-d2a024fb8919',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.075868] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.076064] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.076117] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.076305] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.076392] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.076492] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be updated. [ 1191.107471] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.107632] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.107741] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.107910] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.108087] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.116394] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.116534] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.116606] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.116806] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.116893] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.117114] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.117225] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.117288] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.117437] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.117513] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.117597] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b635a150-2303-4a51-9fa7-6a4633e2197a is going to be updated. [ 1191.121150] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: IN_PROGRESS for 2s [ 1191.150852] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.151036] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.151112] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.151627] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.152235] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.164780] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b635a150-2303-4a51-9fa7-6a4633e2197a in Status: IN_PROGRESS for 2s [ 1191.527415] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dcd9459-fa31-46b3-b003-f31c0576d07a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.527550] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.528260] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4dcd9459-fa31-46b3-b003-f31c0576d07a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.530392] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21573174-8add-46d6-93ef-d2a024fb8919 with status ACTIVE [ 1191.530584] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.530678] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.530748] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.531026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.531062] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.531278] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.531370] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.531488] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.531591] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.531668] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.531849] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.532023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.532023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.532145] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.532218] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.532314] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21573174-8add-46d6-93ef-d2a024fb8919 is going to be updated. [ 1191.553443] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.553588] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.553659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.553860] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.553994] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.554164] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21573174-8add-46d6-93ef-d2a024fb8919" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.034260] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4dcd9459-fa31-46b3-b003-f31c0576d07a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.538382] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.538577] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.538642] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.538870] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.538968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.539100] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a is going to be created. [ 1192.564253] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.564412] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.564473] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.564679] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.564835] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.578144] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a in Status: UNINITIALIZED for 2s [ 1193.130990] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: SUCCESS [ 1193.131272] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.131485] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.131804] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.132104] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.132292] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.132429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.132637] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.132775] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.132929] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.133106] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.174649] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b635a150-2303-4a51-9fa7-6a4633e2197a in Status: SUCCESS [ 1193.174824] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b635a150-2303-4a51-9fa7-6a4633e2197a deletion is rescheduled due to dependency. [ 1193.174938] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.635933] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.636180] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.636229] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.636558] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.636734] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.636838] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.636903] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.637270] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.637470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.637629] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.637881] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.638053] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.638160] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.638405] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.638638] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.638786] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.638886] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.639201] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.639337] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.639477] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.639615] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.142337] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a927ecd-fa02-4905-9c80-5ef71a14a848: rpc.has_security_group_logging(os_id): False [ 1194.165432] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.165624] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.165701] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.165929] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.166028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.166294] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.166393] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.166450] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.166625] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.166716] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.166928] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.167140] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.167216] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.167362] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.167464] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.167660] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.167791] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.167849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.168017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.168096] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.168180] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be updated. [ 1194.234845] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.235057] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.235057] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.235269] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.235418] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.251683] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: IN_PROGRESS for 2s [ 1194.591386] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a in Status: SUCCESS [ 1194.591386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.591386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.591386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.591386] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.591386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.591386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.591386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.591386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.591386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.591386] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4dcd9459-fa31-46b3-b003-f31c0576d07a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.093433] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4dcd9459-fa31-46b3-b003-f31c0576d07a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.596448] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4dcd9459-fa31-46b3-b003-f31c0576d07a: rpc.has_security_group_logging(os_id): False [ 1195.616250] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.616463] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.616463] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.616701] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.616801] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.617056] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.617203] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.617292] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.617393] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.617481] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.617573] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a is going to be created. [ 1195.693021] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.693197] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.693271] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.693484] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.693703] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.707289] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a in Status: IN_PROGRESS for 2s [ 1196.016358] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1196.016603] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1196.269219] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: SUCCESS [ 1196.269512] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.723040] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a in Status: SUCCESS [ 1197.723334] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.797615] env[70520]: INFO networking_nsxv3.common.synchronization [None req-4de0d3de-a85e-4d42-8298-2537a392ee23 tempest-ServerRescueNegativeTestJSON-1807205180 tempest-ServerRescueNegativeTestJSON-1807205180-project-member] Enqueued Resource ID: b93bf2e2-bd30-471b-9e17-a242462b20d9 with Priority: HIGHEST for action security_group_rules [ 1197.798218] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b93bf2e2-bd30-471b-9e17-a242462b20d9 with Priority: HIGHEST for action security_group_rules [ 1197.798640] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b93bf2e2-bd30-471b-9e17-a242462b20d9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.798768] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.798852] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.799302] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.799421] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b93bf2e2-bd30-471b-9e17-a242462b20d9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.925239] env[70520]: INFO networking_nsxv3.common.synchronization [None req-4ce3606f-5cf2-45af-8b2f-f248bb2e3978 tempest-ServerRescueNegativeTestJSON-1807205180 tempest-ServerRescueNegativeTestJSON-1807205180-project-member] Enqueued Resource ID: b93bf2e2-bd30-471b-9e17-a242462b20d9 with Priority: HIGHEST for action security_group_rules [ 1197.925239] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b93bf2e2-bd30-471b-9e17-a242462b20d9 with Priority: HIGHEST for action security_group_rules [ 1197.926616] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b93bf2e2-bd30-471b-9e17-a242462b20d9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.926616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.327512] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.327512] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.327512] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.327512] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.327512] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.327512] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b93bf2e2-bd30-471b-9e17-a242462b20d9 already deleted. [ 1198.327512] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.327859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.327859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.328503] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b93bf2e2-bd30-471b-9e17-a242462b20d9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.391095] env[70520]: INFO networking_nsxv3.common.synchronization [req-8ab5e6f7-e2df-499b-938b-91af32d38f3e req-1a766a88-9a03-4b8c-9ecc-b32895fe42db tempest-ImagesTestJSON-1211196503 tempest-ImagesTestJSON-1211196503-project-member] Enqueued Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1198.391668] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1198.392489] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.392489] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.392489] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.392489] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.392489] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.393659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.393659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.393659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.393659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.393659] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.849653] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.850538] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.850673] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.850916] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.851019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.851123] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b93bf2e2-bd30-471b-9e17-a242462b20d9 already deleted. [ 1198.851218] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.896050] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.896321] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.896321] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.896513] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.896607] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.896843] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.896975] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.897068] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.897259] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.897353] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.897446] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 is going to be updated. [ 1198.927376] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.927587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.927649] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.927886] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.928055] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.940294] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: IN_PROGRESS for 2s [ 1199.370237] env[70520]: INFO networking_nsxv3.common.synchronization [req-021f6250-89ab-4f5e-bbfe-31d5a13cf470 req-f0036d4d-f90a-40e3-98c1-c7c19616a7cf tempest-ServersTestJSON-589199853 tempest-ServersTestJSON-589199853-project-member] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1199.371758] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1199.371758] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.371758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.371758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.371758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.372693] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.372827] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.372890] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.373083] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.373171] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.373265] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.879764] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.381262] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.884028] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.884028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.884028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.884377] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.884377] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.884443] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be updated. [ 1200.919478] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.919478] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.919478] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.919827] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.919827] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.931613] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: IN_PROGRESS for 2s [ 1200.949244] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: SUCCESS [ 1200.949475] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 deletion is rescheduled due to dependency. [ 1200.949567] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.941579] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: SUCCESS [ 1202.941926] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.372238] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1204.372238] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1205.203540] env[70520]: INFO networking_nsxv3.common.synchronization [req-67e509ae-0734-4ca4-b3b8-3ded32da61da req-36374195-93a9-42a2-a4eb-0e188eda7aea tempest-ImagesTestJSON-1211196503 tempest-ImagesTestJSON-1211196503-project-member] Enqueued Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1205.204288] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1205.204496] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.204627] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.204691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.205401] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.205401] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.205401] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.205401] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.205401] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.205650] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.205650] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.527465] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-29 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.527870] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-29" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.527870] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-29" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.528193] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-29" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.528522] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.529020] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.529020] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.529459] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.529556] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.529776] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1205.530125] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1205.530125] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1205.530254] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1205.530745] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1205.530745] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1205.530745] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1205.553116] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1205.553308] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1205.553462] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1205.553636] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-29" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.553966] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-b8386cac-1c2f-4941-bb6d-85e2c90117c0 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.554150] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-b8386cac-1c2f-4941-bb6d-85e2c90117c0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.554272] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-b8386cac-1c2f-4941-bb6d-85e2c90117c0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.554605] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-b8386cac-1c2f-4941-bb6d-85e2c90117c0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.554747] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8386cac-1c2f-4941-bb6d-85e2c90117c0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.708102] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.708982] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.708982] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.708982] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.708982] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.708982] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.708982] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.708982] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.709476] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.709476] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.709476] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 is going to be updated. [ 1205.737091] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.737288] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.737363] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.737575] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.737712] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.746870] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: IN_PROGRESS for 2s [ 1206.057043] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.057330] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.057532] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.057893] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.058139] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.058372] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port b8386cac-1c2f-4941-bb6d-85e2c90117c0 not found, creating... [ 1206.058721] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.058960] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.059164] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.059579] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.059738] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.060074] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.060249] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.060389] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.060623] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.060761] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.060902] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: b8386cac-1c2f-4941-bb6d-85e2c90117c0 is going to be created. [ 1206.089729] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.089969] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.090111] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.090455] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.090901] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.091182] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-b8386cac-1c2f-4941-bb6d-85e2c90117c0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.198439] env[70520]: INFO networking_nsxv3.common.synchronization [req-23795e55-6a72-4a2c-acde-7243cc8aec94 req-ad114843-4b9a-465b-aa1a-bc4cf342f6d8 tempest-DeleteServersTestJSON-1399047283 tempest-DeleteServersTestJSON-1399047283-project-member] Enqueued Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 1206.199056] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGHEST for action security_group_members [ 1206.199421] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.199549] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.199620] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.199872] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.200076] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.200199] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.200267] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.200753] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.200753] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.200753] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.704176] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.704176] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.704176] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.704570] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.704570] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.705453] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.705453] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.705453] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.705453] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.705453] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.705453] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f is going to be updated. [ 1206.740636] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.742494] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.742494] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.742494] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.742494] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.751994] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: IN_PROGRESS for 2s [ 1206.798975] env[70520]: INFO networking_nsxv3.common.synchronization [req-67e509ae-0734-4ca4-b3b8-3ded32da61da req-99a1de4f-7100-42f8-900b-ba41394089c0 service nova] Enqueued Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_rules [ 1206.799182] env[70520]: INFO networking_nsxv3.common.synchronization [req-67e509ae-0734-4ca4-b3b8-3ded32da61da req-99a1de4f-7100-42f8-900b-ba41394089c0 service nova] Enqueued Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1206.799397] env[70520]: INFO networking_nsxv3.common.synchronization [req-67e509ae-0734-4ca4-b3b8-3ded32da61da req-99a1de4f-7100-42f8-900b-ba41394089c0 service nova] Enqueued Resource ID: b8386cac-1c2f-4941-bb6d-85e2c90117c0 with Priority: HIGHEST for action port [ 1206.799900] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_rules [ 1206.800522] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1206.800522] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8386cac-1c2f-4941-bb6d-85e2c90117c0 with Priority: HIGHEST for action port [ 1206.800522] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.800707] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.800707] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.800901] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.800977] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.802153] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.802303] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.802920] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8386cac-1c2f-4941-bb6d-85e2c90117c0 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.802920] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8386cac-1c2f-4941-bb6d-85e2c90117c0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.802920] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8386cac-1c2f-4941-bb6d-85e2c90117c0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.802920] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8386cac-1c2f-4941-bb6d-85e2c90117c0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.803162] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8386cac-1c2f-4941-bb6d-85e2c90117c0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.304272] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.304453] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.304723] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b8386cac-1c2f-4941-bb6d-85e2c90117c0 with status ACTIVE [ 1207.304905] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.305022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.305118] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.305287] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.305372] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.305544] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.305638] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.305696] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.305835] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.305954] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.306322] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.306510] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.306572] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.306718] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.306789] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.306874] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b8386cac-1c2f-4941-bb6d-85e2c90117c0 is going to be updated. [ 1207.328907] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.329072] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.329412] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.329412] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.329546] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.329662] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8386cac-1c2f-4941-bb6d-85e2c90117c0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.468128] env[70520]: INFO networking_nsxv3.common.synchronization [req-c2a8a13a-283f-411b-bbfc-b3e525f89351 req-30739d45-b484-4a1f-a6b9-531bf86d0dc7 tempest-ServerActionsTestOtherA-325270290 tempest-ServerActionsTestOtherA-325270290-project-member] Enqueued Resource ID: 049500dd-1e0c-481a-b7e8-f7bc25741086 with Priority: HIGHEST for action security_group_members [ 1207.468721] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 049500dd-1e0c-481a-b7e8-f7bc25741086 with Priority: HIGHEST for action security_group_members [ 1207.469043] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-049500dd-1e0c-481a-b7e8-f7bc25741086 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.469163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-049500dd-1e0c-481a-b7e8-f7bc25741086" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.469233] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-049500dd-1e0c-481a-b7e8-f7bc25741086" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.469510] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-049500dd-1e0c-481a-b7e8-f7bc25741086" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.469671] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.469782] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.469828] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.469972] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.470232] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.470347] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('049500dd-1e0c-481a-b7e8-f7bc25741086',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.759104] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: SUCCESS [ 1207.759733] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 deletion is rescheduled due to dependency. [ 1207.759968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.760217] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.763289] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.763504] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.763633] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.763709] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.763876] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.763961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.764071] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.972935] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.973719] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.973873] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.974063] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.998207] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.998511] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.998640] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.998701] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.998942] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.999038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.999130] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 049500dd-1e0c-481a-b7e8-f7bc25741086 is going to be updated. [ 1208.035998] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.036297] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.036297] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.036576] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.036576] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.047358] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 049500dd-1e0c-481a-b7e8-f7bc25741086 in Status: IN_PROGRESS for 2s [ 1208.266987] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.764575] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f in Status: SUCCESS [ 1208.764941] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f deletion is rescheduled due to dependency. [ 1208.764941] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.772436] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.276587] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.276587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.276587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.276587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.276587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.276587] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 is going to be updated. [ 1209.317272] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.317420] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.317491] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.317700] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.317840] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.328385] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: IN_PROGRESS for 2s [ 1209.494993] env[70520]: INFO networking_nsxv3.common.synchronization [req-b28b97d2-7451-4332-814f-b8179f9509c1 req-884f899b-0fd6-4090-b2ed-55aee14e307a tempest-AttachVolumeNegativeTest-1224878754 tempest-AttachVolumeNegativeTest-1224878754-project-member] Enqueued Resource ID: 9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb with Priority: HIGHEST for action security_group_members [ 1209.495616] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb with Priority: HIGHEST for action security_group_members [ 1209.495973] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.496156] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.496386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.496588] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.496779] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.497476] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.497476] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.497476] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.497476] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.497476] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.001712] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.002187] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.002187] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.002187] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.002341] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.002461] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.002555] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.002612] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.002761] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.002831] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.002910] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb is going to be updated. [ 1210.030802] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.031085] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.031085] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.031203] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.031354] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.039313] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb in Status: IN_PROGRESS for 2s [ 1210.056357] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 049500dd-1e0c-481a-b7e8-f7bc25741086 in Status: SUCCESS [ 1210.056550] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 049500dd-1e0c-481a-b7e8-f7bc25741086 deletion is rescheduled due to dependency. [ 1210.056635] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-049500dd-1e0c-481a-b7e8-f7bc25741086" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.340787] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: SUCCESS [ 1211.340787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.340787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.341214] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.341214] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.341321] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.341428] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.341738] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.341815] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.341940] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.342219] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.844911] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.845100] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.845182] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.845426] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.845592] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.845684] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.845752] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.845921] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.846023] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.846114] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.846263] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.846355] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.846417] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.846561] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.846692] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.846781] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.846840] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.846975] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.847057] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.847137] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.847221] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.052386] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb in Status: SUCCESS [ 1212.052613] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb deletion is rescheduled due to dependency. [ 1212.052682] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.349298] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 468bd631-24dc-43d9-8a0f-93dcf753e208: rpc.has_security_group_logging(os_id): False [ 1212.368267] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.368412] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.368490] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.368943] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.368943] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.369096] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.369208] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.369271] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.369486] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.369569] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.369758] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.369850] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.369907] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.370261] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.370261] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.370393] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.370514] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.370581] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.370772] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.370851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.370935] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 is going to be updated. [ 1212.436251] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.436447] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.436552] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.436867] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.437096] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.452119] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: IN_PROGRESS for 2s [ 1213.651446] env[70520]: INFO networking_nsxv3.common.synchronization [req-8a798a53-573b-4add-882f-f48e740e18fa req-77f9ec59-02ff-456d-9fa0-e389da574fc8 tempest-ServerRescueNegativeTestJSON-1807205180 tempest-ServerRescueNegativeTestJSON-1807205180-project-member] Enqueued Resource ID: b93bf2e2-bd30-471b-9e17-a242462b20d9 with Priority: HIGHEST for action security_group_members [ 1213.652009] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b93bf2e2-bd30-471b-9e17-a242462b20d9 with Priority: HIGHEST for action security_group_members [ 1213.652344] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b93bf2e2-bd30-471b-9e17-a242462b20d9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.652484] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.652549] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.652792] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.652961] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.653088] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.653158] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.653297] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.653377] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.653468] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b93bf2e2-bd30-471b-9e17-a242462b20d9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.993572] env[70520]: INFO networking_nsxv3.common.synchronization [req-fae790e5-0ed0-470d-be15-69609776ae69 req-c7bd8bbb-f7e5-46f2-9fa4-9657e470be1c tempest-ServersTestJSON-589199853 tempest-ServersTestJSON-589199853-project-member] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1213.994174] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1213.994488] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.994611] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.994674] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.994883] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.995235] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.995361] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.995425] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.995604] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.995704] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.995798] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.137494] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-104 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.137769] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-104" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.137944] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-104" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.138297] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-104" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.138716] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.138943] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.139152] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.139547] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.139753] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.140046] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1214.140193] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1214.140421] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1214.140603] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1214.140748] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1214.140874] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1214.141071] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1214.155706] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.155916] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.155916] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.156166] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.156255] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.156476] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.156587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.156627] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.156775] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.156848] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.156932] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b93bf2e2-bd30-471b-9e17-a242462b20d9 already deleted. [ 1214.157016] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.163190] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1214.163367] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1214.163509] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1214.163700] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-104" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.164042] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-c38b3c5c-55cd-461d-ad54-b9637c48ce4c taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.164222] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-c38b3c5c-55cd-461d-ad54-b9637c48ce4c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.164344] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-c38b3c5c-55cd-461d-ad54-b9637c48ce4c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.164703] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-c38b3c5c-55cd-461d-ad54-b9637c48ce4c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.164845] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c38b3c5c-55cd-461d-ad54-b9637c48ce4c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.468274] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: SUCCESS [ 1214.468504] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.498242] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.666828] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.667216] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.667283] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.667642] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.667900] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.668116] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port c38b3c5c-55cd-461d-ad54-b9637c48ce4c not found, creating... [ 1214.668434] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.668638] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.668762] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.668991] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.669151] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.669513] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.669764] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.669910] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.670143] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.670301] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.670503] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: c38b3c5c-55cd-461d-ad54-b9637c48ce4c is going to be created. [ 1214.692602] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.692805] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.692929] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.693257] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.693553] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.693793] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-c38b3c5c-55cd-461d-ad54-b9637c48ce4c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.000796] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.426098] env[70520]: INFO networking_nsxv3.common.synchronization [req-8a798a53-573b-4add-882f-f48e740e18fa req-475a555c-eeb9-49c6-bb34-827e10fcb1e1 service nova] Enqueued Resource ID: b93bf2e2-bd30-471b-9e17-a242462b20d9 with Priority: HIGHEST for action security_group_rules [ 1215.426689] env[70520]: INFO networking_nsxv3.common.synchronization [req-8a798a53-573b-4add-882f-f48e740e18fa req-475a555c-eeb9-49c6-bb34-827e10fcb1e1 service nova] Enqueued Resource ID: b93bf2e2-bd30-471b-9e17-a242462b20d9 with Priority: HIGHEST for action security_group_members [ 1215.426899] env[70520]: INFO networking_nsxv3.common.synchronization [req-8a798a53-573b-4add-882f-f48e740e18fa req-475a555c-eeb9-49c6-bb34-827e10fcb1e1 service nova] Enqueued Resource ID: c38b3c5c-55cd-461d-ad54-b9637c48ce4c with Priority: HIGHEST for action port [ 1215.427194] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b93bf2e2-bd30-471b-9e17-a242462b20d9 with Priority: HIGHEST for action security_group_rules [ 1215.427358] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b93bf2e2-bd30-471b-9e17-a242462b20d9 with Priority: HIGHEST for action security_group_members [ 1215.427483] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c38b3c5c-55cd-461d-ad54-b9637c48ce4c with Priority: HIGHEST for action port [ 1215.428109] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b93bf2e2-bd30-471b-9e17-a242462b20d9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.428341] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.428516] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.428846] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.428846] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b93bf2e2-bd30-471b-9e17-a242462b20d9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.429816] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b93bf2e2-bd30-471b-9e17-a242462b20d9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.429970] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.430066] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.430268] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.430491] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.431015] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.431128] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.431305] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.431420] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.431535] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b93bf2e2-bd30-471b-9e17-a242462b20d9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.432459] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-c38b3c5c-55cd-461d-ad54-b9637c48ce4c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.432525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c38b3c5c-55cd-461d-ad54-b9637c48ce4c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.432591] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c38b3c5c-55cd-461d-ad54-b9637c48ce4c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.432741] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c38b3c5c-55cd-461d-ad54-b9637c48ce4c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.432814] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c38b3c5c-55cd-461d-ad54-b9637c48ce4c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.504072] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.504072] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.504072] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.504072] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.504072] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.504072] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be updated. [ 1215.541155] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.541355] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.541355] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.541584] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.541748] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.551245] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: IN_PROGRESS for 2s [ 1215.934503] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b93bf2e2-bd30-471b-9e17-a242462b20d9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.935525] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b93bf2e2-bd30-471b-9e17-a242462b20d9 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.935635] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.937198] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c38b3c5c-55cd-461d-ad54-b9637c48ce4c with status ACTIVE [ 1215.937379] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.937491] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.937550] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.937744] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.937855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.938059] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.938184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.938184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.938278] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.938347] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.938521] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.938611] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.938666] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.938797] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.938896] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.938943] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c38b3c5c-55cd-461d-ad54-b9637c48ce4c is going to be updated. [ 1215.961663] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.961790] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.961880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.962103] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.962243] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.962399] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c38b3c5c-55cd-461d-ad54-b9637c48ce4c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.978941] env[70520]: INFO networking_nsxv3.common.synchronization [req-463fd637-7310-4199-bd46-90d7d501fd40 req-5dc7dbdf-abb0-4d81-9d3e-30ba27531fbf tempest-AttachInterfacesTestJSON-1687744298 tempest-AttachInterfacesTestJSON-1687744298-project-member] Enqueued Resource ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a with Priority: HIGHEST for action security_group_members [ 1215.979671] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a with Priority: HIGHEST for action security_group_members [ 1215.980422] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dcd9459-fa31-46b3-b003-f31c0576d07a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.980600] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.980648] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.980811] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.980963] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.981078] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.981134] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.981289] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.981372] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.981466] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dcd9459-fa31-46b3-b003-f31c0576d07a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.286028] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-631 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.286028] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.286028] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.286028] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.286028] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.286347] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.286347] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.286529] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.286692] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.286902] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1216.287025] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1216.287296] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1216.287484] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1216.287619] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1216.287732] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1216.287871] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1216.307784] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1216.307976] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1216.308134] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1216.308314] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.308624] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-5a63e4ed-48f2-4f37-8a6d-50be2483fc26 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.308808] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-5a63e4ed-48f2-4f37-8a6d-50be2483fc26" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.308946] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-5a63e4ed-48f2-4f37-8a6d-50be2483fc26" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.309303] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-5a63e4ed-48f2-4f37-8a6d-50be2483fc26" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.309504] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a63e4ed-48f2-4f37-8a6d-50be2483fc26',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.437056] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b93bf2e2-bd30-471b-9e17-a242462b20d9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.483347] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4dcd9459-fa31-46b3-b003-f31c0576d07a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.812066] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.812292] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.812425] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.812773] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.812945] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.813128] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 5a63e4ed-48f2-4f37-8a6d-50be2483fc26 not found, creating... [ 1216.813392] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.813556] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.813678] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.813897] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.814054] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.814343] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.814546] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.814609] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.814816] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.814952] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.815106] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 5a63e4ed-48f2-4f37-8a6d-50be2483fc26 is going to be created. [ 1216.835645] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.835888] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.836047] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.836312] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.836547] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.836765] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-5a63e4ed-48f2-4f37-8a6d-50be2483fc26" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.939918] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.940276] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.940276] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.940369] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.940684] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.940684] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b93bf2e2-bd30-471b-9e17-a242462b20d9 is going to be created. [ 1216.970247] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.970525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.970525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.970840] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.971051] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.981519] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b93bf2e2-bd30-471b-9e17-a242462b20d9 in Status: UNINITIALIZED for 2s [ 1216.985103] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4dcd9459-fa31-46b3-b003-f31c0576d07a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.491676] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.491676] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.491676] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.491676] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.491676] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.491676] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a is going to be updated. [ 1217.524191] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.524348] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.524420] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.524641] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.524788] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.535084] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a in Status: IN_PROGRESS for 2s [ 1217.563705] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: SUCCESS [ 1217.563943] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.242451] env[70520]: INFO networking_nsxv3.common.synchronization [req-463fd637-7310-4199-bd46-90d7d501fd40 req-bbcd8f2c-2600-485d-9a61-d87204042a76 service nova] Enqueued Resource ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a with Priority: HIGHEST for action security_group_rules [ 1218.242451] env[70520]: INFO networking_nsxv3.common.synchronization [req-463fd637-7310-4199-bd46-90d7d501fd40 req-bbcd8f2c-2600-485d-9a61-d87204042a76 service nova] Enqueued Resource ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a with Priority: HIGHEST for action security_group_members [ 1218.242794] env[70520]: INFO networking_nsxv3.common.synchronization [req-463fd637-7310-4199-bd46-90d7d501fd40 req-bbcd8f2c-2600-485d-9a61-d87204042a76 service nova] Enqueued Resource ID: 5a63e4ed-48f2-4f37-8a6d-50be2483fc26 with Priority: HIGHEST for action port [ 1218.242794] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a with Priority: HIGHEST for action security_group_rules [ 1218.242922] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a with Priority: HIGHEST for action security_group_members [ 1218.243026] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a63e4ed-48f2-4f37-8a6d-50be2483fc26 with Priority: HIGHEST for action port [ 1218.243713] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dcd9459-fa31-46b3-b003-f31c0576d07a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.243829] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.243899] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.244117] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.244233] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dcd9459-fa31-46b3-b003-f31c0576d07a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.245058] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dcd9459-fa31-46b3-b003-f31c0576d07a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.245989] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.245989] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a63e4ed-48f2-4f37-8a6d-50be2483fc26 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.245989] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a63e4ed-48f2-4f37-8a6d-50be2483fc26" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.245989] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a63e4ed-48f2-4f37-8a6d-50be2483fc26" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.245989] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a63e4ed-48f2-4f37-8a6d-50be2483fc26" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.245989] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a63e4ed-48f2-4f37-8a6d-50be2483fc26',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.747437] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dcd9459-fa31-46b3-b003-f31c0576d07a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.747583] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.747787] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5a63e4ed-48f2-4f37-8a6d-50be2483fc26 with status ACTIVE [ 1218.747961] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.748088] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.748154] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.748367] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.748455] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.748626] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.748718] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.748783] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.748944] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.749034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.749218] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.749316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.749379] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.749517] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.749594] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.749711] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5a63e4ed-48f2-4f37-8a6d-50be2483fc26 is going to be updated. [ 1218.772557] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.772709] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.772747] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.772965] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.773102] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.773244] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a63e4ed-48f2-4f37-8a6d-50be2483fc26" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.993429] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b93bf2e2-bd30-471b-9e17-a242462b20d9 in Status: SUCCESS [ 1218.993429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.993429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.993429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.993429] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.993429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.993429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.993429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.993429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.993429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.993429] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b93bf2e2-bd30-471b-9e17-a242462b20d9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.496276] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b93bf2e2-bd30-471b-9e17-a242462b20d9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.546945] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a in Status: IN_PROGRESS for 4s [ 1220.001731] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b93bf2e2-bd30-471b-9e17-a242462b20d9: rpc.has_security_group_logging(os_id): False [ 1220.035974] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.036195] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.036299] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.036595] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.036723] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.037077] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.037225] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.037316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.038142] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.038142] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.038142] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b93bf2e2-bd30-471b-9e17-a242462b20d9 is going to be created. [ 1220.107196] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.107353] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.107421] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.107636] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.107848] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.123599] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b93bf2e2-bd30-471b-9e17-a242462b20d9 in Status: IN_PROGRESS for 2s [ 1220.819948] env[70520]: INFO networking_nsxv3.common.synchronization [None req-9dd944f6-7793-4d69-a222-1604d25c1075 tempest-AttachVolumeNegativeTest-1224878754 tempest-AttachVolumeNegativeTest-1224878754-project-member] Enqueued Resource ID: 583cdb63-56b7-4a80-baa2-c544dc5618c9 with Priority: HIGHEST for action security_group_rules [ 1220.820593] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583cdb63-56b7-4a80-baa2-c544dc5618c9 with Priority: HIGHEST for action security_group_rules [ 1220.821842] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-583cdb63-56b7-4a80-baa2-c544dc5618c9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.822105] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.822240] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.822619] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.822694] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('583cdb63-56b7-4a80-baa2-c544dc5618c9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.894790] env[70520]: INFO networking_nsxv3.common.synchronization [None req-cc2ac9e1-397a-45d8-a7d1-df37be85c147 tempest-AttachVolumeNegativeTest-1224878754 tempest-AttachVolumeNegativeTest-1224878754-project-member] Enqueued Resource ID: 583cdb63-56b7-4a80-baa2-c544dc5618c9 with Priority: HIGHEST for action security_group_rules [ 1220.894790] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583cdb63-56b7-4a80-baa2-c544dc5618c9 with Priority: HIGHEST for action security_group_rules [ 1220.894937] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-583cdb63-56b7-4a80-baa2-c544dc5618c9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.895037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.347658] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.347879] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.348025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.348219] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.348326] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.348455] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 583cdb63-56b7-4a80-baa2-c544dc5618c9 already deleted. [ 1221.348633] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.348881] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.348971] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.349049] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('583cdb63-56b7-4a80-baa2-c544dc5618c9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.557857] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a in Status: SUCCESS [ 1221.558033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.558366] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.558366] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.558577] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.558667] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.558724] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.558869] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.558943] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.559044] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dcd9459-fa31-46b3-b003-f31c0576d07a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.872758] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.872758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.872758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.872758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.872758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.873255] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 583cdb63-56b7-4a80-baa2-c544dc5618c9 already deleted. [ 1221.873255] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.063236] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4dcd9459-fa31-46b3-b003-f31c0576d07a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.137795] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b93bf2e2-bd30-471b-9e17-a242462b20d9 in Status: SUCCESS [ 1222.138065] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.566125] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4dcd9459-fa31-46b3-b003-f31c0576d07a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.655661] env[70520]: INFO networking_nsxv3.common.synchronization [req-249ba913-e2d8-4544-8c39-59cde175a39e req-0d9aa53b-60cf-41ea-b1d6-89caf1869d38 tempest-AttachVolumeTestJSON-1760709661 tempest-AttachVolumeTestJSON-1760709661-project-member] Enqueued Resource ID: ed51a6f5-8537-40e6-9b09-ff216cb9a61d with Priority: HIGHEST for action security_group_members [ 1222.656283] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed51a6f5-8537-40e6-9b09-ff216cb9a61d with Priority: HIGHEST for action security_group_members [ 1222.660903] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed51a6f5-8537-40e6-9b09-ff216cb9a61d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.661156] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed51a6f5-8537-40e6-9b09-ff216cb9a61d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.661230] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed51a6f5-8537-40e6-9b09-ff216cb9a61d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.661475] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed51a6f5-8537-40e6-9b09-ff216cb9a61d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.661683] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.661810] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.661890] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.662220] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.662316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.662452] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed51a6f5-8537-40e6-9b09-ff216cb9a61d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.058505] env[70520]: INFO networking_nsxv3.common.synchronization [None req-f3d72bd2-d447-4a67-bc23-57d12b1ab01c None None] Enqueued Resource ID: 5d80820c-ac55-4165-a1f3-ffb68dd46f85 with Priority: HIGHEST for action port [ 1223.058505] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d80820c-ac55-4165-a1f3-ffb68dd46f85 with Priority: HIGHEST for action port [ 1223.058505] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d80820c-ac55-4165-a1f3-ffb68dd46f85 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.058505] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d80820c-ac55-4165-a1f3-ffb68dd46f85" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.059383] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d80820c-ac55-4165-a1f3-ffb68dd46f85" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.059845] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d80820c-ac55-4165-a1f3-ffb68dd46f85" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.060112] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d80820c-ac55-4165-a1f3-ffb68dd46f85',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.068380] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.070042] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.070042] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.070042] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.070042] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.070042] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a is going to be updated. [ 1223.103185] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.104637] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.105092] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.106666] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.106863] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.117230] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a in Status: IN_PROGRESS for 2s [ 1223.164550] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.164747] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.164805] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.164989] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.192930] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.193140] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.193580] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.193580] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.193580] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.193580] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.193580] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed51a6f5-8537-40e6-9b09-ff216cb9a61d is going to be updated. [ 1223.225452] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.225614] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.225704] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.225988] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.226207] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.236453] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed51a6f5-8537-40e6-9b09-ff216cb9a61d in Status: IN_PROGRESS for 2s [ 1223.563533] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d80820c-ac55-4165-a1f3-ffb68dd46f85 [ 1223.563533] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.563533] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.563533] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.563773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.563773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.563773] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d80820c-ac55-4165-a1f3-ffb68dd46f85 already deleted. [ 1223.563853] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d80820c-ac55-4165-a1f3-ffb68dd46f85" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.983614] env[70520]: INFO networking_nsxv3.common.synchronization [req-69338d65-1b11-47bf-8ef0-12368f715225 req-3fb1e59c-7d27-4277-869d-237f69245e92 tempest-ServerActionsTestOtherA-325270290 tempest-ServerActionsTestOtherA-325270290-project-member] Enqueued Resource ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa with Priority: HIGHEST for action security_group_members [ 1223.985878] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa with Priority: HIGHEST for action security_group_members [ 1223.986852] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.987133] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.987335] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.987738] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.988097] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.988469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.988469] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.988745] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.988819] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.989087] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9526fc0a-60e6-4c7c-a0b5-b827fe4038aa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.491148] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-572 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.491629] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-572" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.491629] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-572" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.491984] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-572" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.491984] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.492152] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.492257] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.492482] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.492729] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.492839] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1224.492958] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1224.493102] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1224.493221] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1224.493336] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1224.493445] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1224.493580] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1224.495216] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.495216] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.495456] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.495456] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.523024] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1224.523024] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1224.523024] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1224.523024] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-572" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.523024] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-91262fc5-6484-41e2-9aeb-50ef3dc7f9e7 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.523024] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-91262fc5-6484-41e2-9aeb-50ef3dc7f9e7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.523024] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-91262fc5-6484-41e2-9aeb-50ef3dc7f9e7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.523024] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-91262fc5-6484-41e2-9aeb-50ef3dc7f9e7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.523024] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91262fc5-6484-41e2-9aeb-50ef3dc7f9e7',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.524184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.524512] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.524744] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.524895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.525160] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.525905] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.526142] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa is going to be updated. [ 1224.557447] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.557447] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.557447] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.557447] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.557447] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.565589] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa in Status: IN_PROGRESS for 2s [ 1225.020439] env[70520]: INFO networking_nsxv3.common.synchronization [None req-df6cfa9c-1f08-4699-b3b4-dc6ea070456c None None] Enqueued Resource ID: 0ebf2085-456d-46b8-b1e7-dd09632c13b9 with Priority: HIGHEST for action port [ 1225.020439] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ebf2085-456d-46b8-b1e7-dd09632c13b9 with Priority: HIGHEST for action port [ 1225.020439] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ebf2085-456d-46b8-b1e7-dd09632c13b9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.020439] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ebf2085-456d-46b8-b1e7-dd09632c13b9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.020439] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ebf2085-456d-46b8-b1e7-dd09632c13b9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.020914] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ebf2085-456d-46b8-b1e7-dd09632c13b9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.021054] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ebf2085-456d-46b8-b1e7-dd09632c13b9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.028973] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.029860] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.029860] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.029860] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.029860] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.030084] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 91262fc5-6484-41e2-9aeb-50ef3dc7f9e7 not found, creating... [ 1225.030366] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.030545] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.030726] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.031100] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.031302] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.031589] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.031732] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.031873] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.032291] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.032495] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.032786] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 91262fc5-6484-41e2-9aeb-50ef3dc7f9e7 is going to be created. [ 1225.055039] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.055039] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.055039] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.055287] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.055628] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.055727] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-91262fc5-6484-41e2-9aeb-50ef3dc7f9e7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.134538] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a in Status: SUCCESS [ 1225.134804] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.135069] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.135302] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.135486] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.135603] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.135680] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.137070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.137070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.137070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.137070] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4dcd9459-fa31-46b3-b003-f31c0576d07a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.250217] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed51a6f5-8537-40e6-9b09-ff216cb9a61d in Status: SUCCESS [ 1225.250429] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed51a6f5-8537-40e6-9b09-ff216cb9a61d deletion is rescheduled due to dependency. [ 1225.250548] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed51a6f5-8537-40e6-9b09-ff216cb9a61d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.526044] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ebf2085-456d-46b8-b1e7-dd09632c13b9 [ 1225.526365] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.526491] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.526539] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.526820] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.526907] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.527023] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ebf2085-456d-46b8-b1e7-dd09632c13b9 already deleted. [ 1225.527174] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ebf2085-456d-46b8-b1e7-dd09632c13b9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.638652] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4dcd9459-fa31-46b3-b003-f31c0576d07a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.862775] env[70520]: INFO networking_nsxv3.common.synchronization [req-69338d65-1b11-47bf-8ef0-12368f715225 req-ce10b50b-f453-4417-b5e6-74e82a1cd092 service nova] Enqueued Resource ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa with Priority: HIGHEST for action security_group_rules [ 1225.862775] env[70520]: INFO networking_nsxv3.common.synchronization [req-69338d65-1b11-47bf-8ef0-12368f715225 req-ce10b50b-f453-4417-b5e6-74e82a1cd092 service nova] Enqueued Resource ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa with Priority: HIGHEST for action security_group_members [ 1225.862775] env[70520]: INFO networking_nsxv3.common.synchronization [req-69338d65-1b11-47bf-8ef0-12368f715225 req-ce10b50b-f453-4417-b5e6-74e82a1cd092 service nova] Enqueued Resource ID: 91262fc5-6484-41e2-9aeb-50ef3dc7f9e7 with Priority: HIGHEST for action port [ 1225.863037] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa with Priority: HIGHEST for action security_group_rules [ 1225.863170] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa with Priority: HIGHEST for action security_group_members [ 1225.863266] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91262fc5-6484-41e2-9aeb-50ef3dc7f9e7 with Priority: HIGHEST for action port [ 1225.865131] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.865131] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.865131] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.865131] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.865131] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9526fc0a-60e6-4c7c-a0b5-b827fe4038aa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.865131] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.865476] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.865476] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-91262fc5-6484-41e2-9aeb-50ef3dc7f9e7 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.865476] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91262fc5-6484-41e2-9aeb-50ef3dc7f9e7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.865732] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91262fc5-6484-41e2-9aeb-50ef3dc7f9e7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.865732] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91262fc5-6484-41e2-9aeb-50ef3dc7f9e7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.865839] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91262fc5-6484-41e2-9aeb-50ef3dc7f9e7',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.143125] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4dcd9459-fa31-46b3-b003-f31c0576d07a: rpc.has_security_group_logging(os_id): False [ 1226.160961] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.160961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.160961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.160961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.160961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.160961] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.160961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.161500] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.161500] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.161500] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.161500] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a is going to be updated. [ 1226.165465] env[70520]: INFO networking_nsxv3.common.synchronization [req-dd4aec94-e22b-4424-8644-63243393e910 req-58d91fcf-1186-47d3-b055-a968ec965d63 tempest-ImagesTestJSON-1211196503 tempest-ImagesTestJSON-1211196503-project-member] Enqueued Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1226.167029] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGHEST for action security_group_members [ 1226.167029] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.167029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.167029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.167029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.167320] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.167320] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.167320] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.167767] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.167767] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.167767] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.222979] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.223140] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.223206] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.223418] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.223563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.237674] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a in Status: IN_PROGRESS for 2s [ 1226.367357] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.367573] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.370044] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 91262fc5-6484-41e2-9aeb-50ef3dc7f9e7 with status ACTIVE [ 1226.370401] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.370564] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.370626] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.371961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.371961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.371961] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.371961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.371961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.371961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.371961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.371961] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.372404] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.372404] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.372404] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.372404] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.372529] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 91262fc5-6484-41e2-9aeb-50ef3dc7f9e7 is going to be updated. [ 1226.398396] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.398645] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.398645] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.398784] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.398960] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.399156] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91262fc5-6484-41e2-9aeb-50ef3dc7f9e7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.588539] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa in Status: SUCCESS [ 1226.588920] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa deletion is rescheduled due to dependency. [ 1226.588920] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.588993] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.589243] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.589437] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.589754] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.589868] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.590055] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.590142] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.590239] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9526fc0a-60e6-4c7c-a0b5-b827fe4038aa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.670879] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.670879] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.670879] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.670879] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.670879] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.671166] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.671345] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.671413] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.671701] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.671701] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.671825] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 is going to be updated. [ 1226.703635] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.703635] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.703635] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.703635] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.703635] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.712846] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: IN_PROGRESS for 2s [ 1226.934906] env[70520]: INFO networking_nsxv3.common.synchronization [req-c33b3561-dede-46b7-887d-c07de3a5bf9f req-8e296ac4-474c-4408-bce1-27ffc5e28ed0 tempest-AttachVolumeNegativeTest-1224878754 tempest-AttachVolumeNegativeTest-1224878754-project-member] Enqueued Resource ID: 583cdb63-56b7-4a80-baa2-c544dc5618c9 with Priority: HIGHEST for action security_group_members [ 1226.935213] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583cdb63-56b7-4a80-baa2-c544dc5618c9 with Priority: HIGHEST for action security_group_members [ 1226.935616] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-583cdb63-56b7-4a80-baa2-c544dc5618c9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.935767] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.935834] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.936575] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.936575] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.936575] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.936763] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.936818] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.936910] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.937108] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('583cdb63-56b7-4a80-baa2-c544dc5618c9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.092322] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9526fc0a-60e6-4c7c-a0b5-b827fe4038aa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.236673] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-811 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.236876] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-811" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.237048] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-811" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.237323] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-811" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.237651] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.237804] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.237950] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.238174] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.238323] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.238563] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1227.238707] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1227.238826] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1227.238937] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1227.239069] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1227.239181] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1227.239315] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1227.262146] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1227.262371] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1227.262570] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1227.262778] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-811" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.263326] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-2e691d8f-a6e9-49cf-b766-516f3c1ab235 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.263607] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-2e691d8f-a6e9-49cf-b766-516f3c1ab235" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.263765] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-2e691d8f-a6e9-49cf-b766-516f3c1ab235" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.264140] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-2e691d8f-a6e9-49cf-b766-516f3c1ab235" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.264316] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e691d8f-a6e9-49cf-b766-516f3c1ab235',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.438941] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.439123] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.439193] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.439402] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.439486] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.439707] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.439803] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.439861] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.440033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.440092] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.440164] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 583cdb63-56b7-4a80-baa2-c544dc5618c9 already deleted. [ 1227.440237] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.594642] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9526fc0a-60e6-4c7c-a0b5-b827fe4038aa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.767769] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.768043] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.768175] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.768465] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.768616] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.768775] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 2e691d8f-a6e9-49cf-b766-516f3c1ab235 not found, creating... [ 1227.769053] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.769219] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.769336] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.769579] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.769721] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.770018] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.770198] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.770316] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.770526] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.770659] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.770799] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 2e691d8f-a6e9-49cf-b766-516f3c1ab235 is going to be created. [ 1227.791869] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.792161] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.792294] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.792585] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.792834] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.793078] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-2e691d8f-a6e9-49cf-b766-516f3c1ab235" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.096731] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.096924] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.096981] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.097205] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.097303] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.097387] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa is going to be updated. [ 1228.125965] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.126265] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.126265] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.126523] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.126650] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.137112] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa in Status: IN_PROGRESS for 2s [ 1228.257037] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a in Status: SUCCESS [ 1228.257271] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.481760] env[70520]: INFO networking_nsxv3.common.synchronization [req-c33b3561-dede-46b7-887d-c07de3a5bf9f req-23ad2e8b-7b06-4071-9243-0f794e376697 service nova] Enqueued Resource ID: 583cdb63-56b7-4a80-baa2-c544dc5618c9 with Priority: HIGHEST for action security_group_rules [ 1228.481760] env[70520]: INFO networking_nsxv3.common.synchronization [req-c33b3561-dede-46b7-887d-c07de3a5bf9f req-23ad2e8b-7b06-4071-9243-0f794e376697 service nova] Enqueued Resource ID: 583cdb63-56b7-4a80-baa2-c544dc5618c9 with Priority: HIGHEST for action security_group_members [ 1228.481973] env[70520]: INFO networking_nsxv3.common.synchronization [req-c33b3561-dede-46b7-887d-c07de3a5bf9f req-23ad2e8b-7b06-4071-9243-0f794e376697 service nova] Enqueued Resource ID: 2e691d8f-a6e9-49cf-b766-516f3c1ab235 with Priority: HIGHEST for action port [ 1228.482548] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583cdb63-56b7-4a80-baa2-c544dc5618c9 with Priority: HIGHEST for action security_group_rules [ 1228.482674] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583cdb63-56b7-4a80-baa2-c544dc5618c9 with Priority: HIGHEST for action security_group_members [ 1228.482763] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e691d8f-a6e9-49cf-b766-516f3c1ab235 with Priority: HIGHEST for action port [ 1228.483155] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-583cdb63-56b7-4a80-baa2-c544dc5618c9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.483345] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.483758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.483758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.483758] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('583cdb63-56b7-4a80-baa2-c544dc5618c9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.484782] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-583cdb63-56b7-4a80-baa2-c544dc5618c9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.484946] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.485250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.485250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.485505] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.485855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.485855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.485855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.486919] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.486919] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('583cdb63-56b7-4a80-baa2-c544dc5618c9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.486919] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e691d8f-a6e9-49cf-b766-516f3c1ab235 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.487349] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e691d8f-a6e9-49cf-b766-516f3c1ab235" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.487349] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e691d8f-a6e9-49cf-b766-516f3c1ab235" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.487349] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e691d8f-a6e9-49cf-b766-516f3c1ab235" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.487588] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e691d8f-a6e9-49cf-b766-516f3c1ab235',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.723875] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 in Status: SUCCESS [ 1228.723875] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 deletion is rescheduled due to dependency. [ 1228.723875] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.989739] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-583cdb63-56b7-4a80-baa2-c544dc5618c9 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.989739] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.991338] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('583cdb63-56b7-4a80-baa2-c544dc5618c9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.992530] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e691d8f-a6e9-49cf-b766-516f3c1ab235 with status ACTIVE [ 1228.992735] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.992863] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.992932] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.993152] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.993239] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.993416] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.993516] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.993895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.993895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.993895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.994042] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.994096] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.994130] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.997350] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.997350] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.997350] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e691d8f-a6e9-49cf-b766-516f3c1ab235 is going to be updated. [ 1229.022729] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.022936] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.022993] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.023187] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.023327] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.023486] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e691d8f-a6e9-49cf-b766-516f3c1ab235" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.500696] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('583cdb63-56b7-4a80-baa2-c544dc5618c9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.576881] env[70520]: INFO networking_nsxv3.common.synchronization [req-4fa74614-fce6-4bf3-9021-3f13659d4d9b req-a94faddd-06dd-4d5b-8be6-620653f62946 tempest-ServersTestJSON-589199853 tempest-ServersTestJSON-589199853-project-member] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1229.577594] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1229.578479] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.578664] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.578763] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.579026] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.579234] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.579376] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.579465] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.579699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.579820] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.579946] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.004491] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.004962] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.004962] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.006962] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.007173] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.007288] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 583cdb63-56b7-4a80-baa2-c544dc5618c9 is going to be created. [ 1230.035659] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.035659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.035659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.035659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.035659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.048460] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 583cdb63-56b7-4a80-baa2-c544dc5618c9 in Status: UNINITIALIZED for 2s [ 1230.082876] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.151024] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa in Status: SUCCESS [ 1230.151024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.151024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.151024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.151024] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.151024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.151024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.151024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.151024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.151024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.151024] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9526fc0a-60e6-4c7c-a0b5-b827fe4038aa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.333691] env[70520]: INFO networking_nsxv3.common.synchronization [None req-44ba0860-749f-4749-a3d8-255e383e1f9d tempest-AttachInterfacesTestJSON-1687744298 tempest-AttachInterfacesTestJSON-1687744298-project-member] Enqueued Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_members [ 1230.334596] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_members [ 1230.335059] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.335251] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.335322] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.337964] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.338573] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.338722] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.338811] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.338992] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.339119] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.339224] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.382429] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-831 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.382429] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-831" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.382429] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-831" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.382429] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-831" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.382429] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.382806] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.383103] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.383490] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.383933] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.384320] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1230.384531] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1230.384726] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1230.384986] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1230.385204] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1230.385409] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1230.385655] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1230.444190] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1230.444190] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.057 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1230.444190] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1230.444190] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-831" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.444190] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-05aecd64-8419-4427-9498-6b96235f6ed1 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.444190] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-05aecd64-8419-4427-9498-6b96235f6ed1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.444190] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-05aecd64-8419-4427-9498-6b96235f6ed1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.445515] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-05aecd64-8419-4427-9498-6b96235f6ed1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.445827] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05aecd64-8419-4427-9498-6b96235f6ed1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.584206] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.655481] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.655481] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.655481] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.655481] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.655481] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.655481] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.655481] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.655481] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.655481] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.655481] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.655481] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.655481] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.655481] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.655481] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.655481] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.655481] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.656436] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.656436] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.656436] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.656436] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.656436] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9526fc0a-60e6-4c7c-a0b5-b827fe4038aa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.843368] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.843613] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.843782] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.844123] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.844239] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.844561] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.844738] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.844851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.845176] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.845316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.845485] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a is going to be updated. [ 1230.882074] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.882246] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.882299] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.882539] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.882682] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.896175] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: IN_PROGRESS for 2s [ 1230.952117] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.954019] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.954019] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.954019] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.954019] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.954019] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 05aecd64-8419-4427-9498-6b96235f6ed1 not found, creating... [ 1230.954019] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.954019] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.954019] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.954419] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.954506] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.954795] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.954920] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.955194] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.955503] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.955704] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.955874] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 05aecd64-8419-4427-9498-6b96235f6ed1 is going to be created. [ 1230.984942] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.985397] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.987027] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.987027] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.987027] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.987027] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-05aecd64-8419-4427-9498-6b96235f6ed1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.090025] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.090025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.090025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.090025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.090025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.090025] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be updated. [ 1231.137414] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.137584] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.137629] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.137858] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.138214] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.152689] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: IN_PROGRESS for 2s [ 1231.158175] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa: rpc.has_security_group_logging(os_id): False [ 1231.191179] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.191326] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.191392] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.191614] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.191702] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.191901] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.192066] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.192162] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.192370] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.192471] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.192753] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.192856] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.192916] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.193077] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.193148] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.193344] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.193434] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.193491] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.193625] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.193692] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.193772] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa is going to be updated. [ 1231.297403] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.297686] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.297723] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.298288] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.298288] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.316440] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa in Status: IN_PROGRESS for 2s [ 1231.774210] env[70520]: INFO networking_nsxv3.common.synchronization [req-4fa74614-fce6-4bf3-9021-3f13659d4d9b req-a4d672bf-58c8-4916-983c-85fc66adad77 service nova] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_rules [ 1231.774396] env[70520]: INFO networking_nsxv3.common.synchronization [req-4fa74614-fce6-4bf3-9021-3f13659d4d9b req-a4d672bf-58c8-4916-983c-85fc66adad77 service nova] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1231.774536] env[70520]: INFO networking_nsxv3.common.synchronization [req-4fa74614-fce6-4bf3-9021-3f13659d4d9b req-a4d672bf-58c8-4916-983c-85fc66adad77 service nova] Enqueued Resource ID: 05aecd64-8419-4427-9498-6b96235f6ed1 with Priority: HIGHEST for action port [ 1231.774769] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_rules [ 1231.774920] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1231.774982] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05aecd64-8419-4427-9498-6b96235f6ed1 with Priority: HIGHEST for action port [ 1231.775541] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.775925] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.775925] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.775925] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.776103] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.777139] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.777239] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.777430] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-05aecd64-8419-4427-9498-6b96235f6ed1 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.777529] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05aecd64-8419-4427-9498-6b96235f6ed1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.777600] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05aecd64-8419-4427-9498-6b96235f6ed1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.777797] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05aecd64-8419-4427-9498-6b96235f6ed1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.777878] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05aecd64-8419-4427-9498-6b96235f6ed1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.059747] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 583cdb63-56b7-4a80-baa2-c544dc5618c9 in Status: SUCCESS [ 1232.060382] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.060382] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.060608] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.060852] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.061013] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.061101] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.061324] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.061407] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.061578] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.061578] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('583cdb63-56b7-4a80-baa2-c544dc5618c9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.159466] env[70520]: INFO networking_nsxv3.common.synchronization [None req-e475c9d6-6fdf-4ef1-8f46-f8f5d803fd07 tempest-AttachVolumeTestJSON-1760709661 tempest-AttachVolumeTestJSON-1760709661-project-member] Enqueued Resource ID: f112ebf4-d53d-408e-b028-a56b0ec3f4cb with Priority: HIGHEST for action security_group_rules [ 1232.159982] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f112ebf4-d53d-408e-b028-a56b0ec3f4cb with Priority: HIGHEST for action security_group_rules [ 1232.160391] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f112ebf4-d53d-408e-b028-a56b0ec3f4cb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.160568] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.160674] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.160965] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.161115] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f112ebf4-d53d-408e-b028-a56b0ec3f4cb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.237555] env[70520]: INFO networking_nsxv3.common.synchronization [None req-7e1405d5-6fca-4f80-aaf7-dad43f2d8cb9 tempest-AttachVolumeTestJSON-1760709661 tempest-AttachVolumeTestJSON-1760709661-project-member] Enqueued Resource ID: f112ebf4-d53d-408e-b028-a56b0ec3f4cb with Priority: HIGHEST for action security_group_rules [ 1232.238201] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f112ebf4-d53d-408e-b028-a56b0ec3f4cb with Priority: HIGHEST for action security_group_rules [ 1232.238517] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f112ebf4-d53d-408e-b028-a56b0ec3f4cb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.238618] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.280993] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.281172] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.281350] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05aecd64-8419-4427-9498-6b96235f6ed1 with status ACTIVE [ 1232.281515] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.281625] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.281695] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.281961] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.282028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.282186] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.282297] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.282362] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.282518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.282596] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.282778] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.282936] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.282936] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.284737] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.284737] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.284737] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05aecd64-8419-4427-9498-6b96235f6ed1 is going to be updated. [ 1232.311889] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.312848] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.313169] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.314429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.314429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.314429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05aecd64-8419-4427-9498-6b96235f6ed1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.563859] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('583cdb63-56b7-4a80-baa2-c544dc5618c9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.685180] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.685374] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.685417] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.685707] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.685843] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.685948] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f112ebf4-d53d-408e-b028-a56b0ec3f4cb already deleted. [ 1232.686441] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.686642] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.686828] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.686915] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f112ebf4-d53d-408e-b028-a56b0ec3f4cb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.906867] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: SUCCESS [ 1232.906867] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a deletion is rescheduled due to dependency. [ 1232.906867] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.071100] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 583cdb63-56b7-4a80-baa2-c544dc5618c9: rpc.has_security_group_logging(os_id): False [ 1233.088245] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.088590] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.088780] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.090365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.090365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.090365] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.090365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.090365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.090365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.090365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.090365] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 583cdb63-56b7-4a80-baa2-c544dc5618c9 is going to be created. [ 1233.155819] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.158151] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.158367] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.158684] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.158951] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.169629] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: SUCCESS [ 1233.170012] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.170273] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.170625] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.170951] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.171210] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.171357] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.171653] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.171831] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.172032] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.173739] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 583cdb63-56b7-4a80-baa2-c544dc5618c9 in Status: IN_PROGRESS for 2s [ 1233.208883] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.209312] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.209312] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.209312] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.209473] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.209473] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f112ebf4-d53d-408e-b028-a56b0ec3f4cb already deleted. [ 1233.209555] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.333173] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa in Status: SUCCESS [ 1233.333463] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.677846] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.146308] env[70520]: INFO networking_nsxv3.common.synchronization [req-7d041ee5-bd6a-4ece-b717-65b01789553c req-4f75a77c-b7dd-4752-8dfe-4325bac4cdc7 tempest-ServerActionsTestOtherA-325270290 tempest-ServerActionsTestOtherA-325270290-project-member] Enqueued Resource ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa with Priority: HIGHEST for action security_group_members [ 1234.146870] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa with Priority: HIGHEST for action security_group_members [ 1234.147720] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.147720] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.147720] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.147720] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.147720] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.148209] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.148209] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.148209] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.148209] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.148209] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9526fc0a-60e6-4c7c-a0b5-b827fe4038aa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.182933] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.194355] env[70520]: INFO networking_nsxv3.common.synchronization [req-7d041ee5-bd6a-4ece-b717-65b01789553c req-4f75a77c-b7dd-4752-8dfe-4325bac4cdc7 tempest-ServerActionsTestOtherA-325270290 tempest-ServerActionsTestOtherA-325270290-project-member] Enqueued Resource ID: 91262fc5-6484-41e2-9aeb-50ef3dc7f9e7 with Priority: HIGHEST for action port [ 1234.195186] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91262fc5-6484-41e2-9aeb-50ef3dc7f9e7 with Priority: HIGHEST for action port [ 1234.195560] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-91262fc5-6484-41e2-9aeb-50ef3dc7f9e7 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.195693] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91262fc5-6484-41e2-9aeb-50ef3dc7f9e7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.195763] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91262fc5-6484-41e2-9aeb-50ef3dc7f9e7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.197798] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91262fc5-6484-41e2-9aeb-50ef3dc7f9e7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.197798] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91262fc5-6484-41e2-9aeb-50ef3dc7f9e7',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.651303] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.651303] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.651303] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.651303] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.651303] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.651613] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.651613] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.651613] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.651721] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.651780] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.651924] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa is going to be updated. [ 1234.680428] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.680650] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.680650] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.683175] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.683175] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.685747] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.685924] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.686020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.686282] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.686458] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.686565] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be updated. [ 1234.692261] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa in Status: IN_PROGRESS for 2s [ 1234.701028] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 91262fc5-6484-41e2-9aeb-50ef3dc7f9e7 with status ACTIVE [ 1234.701028] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.701028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.701028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.701028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.701028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.701028] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.701028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.701028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.701028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.701028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.701525] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.701525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.701525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.701525] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.701665] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.701665] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 91262fc5-6484-41e2-9aeb-50ef3dc7f9e7 is going to be updated. [ 1234.723762] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.723762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.723960] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.724024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.724221] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.730188] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.730188] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.730188] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.730188] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.730188] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.730495] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91262fc5-6484-41e2-9aeb-50ef3dc7f9e7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.734719] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: IN_PROGRESS for 2s [ 1234.922318] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-631 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.922615] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.922784] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.922907] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.923186] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.923346] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.923463] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.923684] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.923842] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.924339] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1234.924553] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1234.924617] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1234.924694] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1234.924810] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1234.924919] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1234.925067] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1234.946074] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1234.947508] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1234.947508] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1234.947508] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.947508] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-dce39464-ac48-4034-9e86-7af7e94f49d1 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.947508] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-dce39464-ac48-4034-9e86-7af7e94f49d1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.947508] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-dce39464-ac48-4034-9e86-7af7e94f49d1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.947832] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-dce39464-ac48-4034-9e86-7af7e94f49d1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.947917] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dce39464-ac48-4034-9e86-7af7e94f49d1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.186741] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 583cdb63-56b7-4a80-baa2-c544dc5618c9 in Status: SUCCESS [ 1235.187891] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.454404] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.454829] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.454829] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.455306] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.455306] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.455443] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port dce39464-ac48-4034-9e86-7af7e94f49d1 not found, creating... [ 1235.455708] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.455878] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.456018] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.456280] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.456547] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.456789] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.456936] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.457368] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.457465] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.457565] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.457744] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: dce39464-ac48-4034-9e86-7af7e94f49d1 is going to be created. [ 1235.490105] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.490375] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.490548] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.491303] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.491406] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.491629] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-dce39464-ac48-4034-9e86-7af7e94f49d1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.084284] env[70520]: INFO networking_nsxv3.common.synchronization [req-1cb6aeba-73fb-4519-bdcd-4f5df5682e62 req-f19400da-9ef0-4236-8be5-a943ac7d71e3 tempest-ServerMetadataTestJSON-1315216060 tempest-ServerMetadataTestJSON-1315216060-project-member] Enqueued Resource ID: b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe with Priority: HIGHEST for action security_group_members [ 1236.084900] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe with Priority: HIGHEST for action security_group_members [ 1236.085154] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.085272] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.085336] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.085578] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.086196] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.086196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.086196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.086196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.086383] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.086593] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.200715] env[70520]: INFO networking_nsxv3.common.synchronization [req-3b967584-56b7-43fc-b8a2-03ea68955e56 req-1132af07-4cda-4c9a-a062-4617be0adc37 service nova] Enqueued Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_rules [ 1236.201396] env[70520]: INFO networking_nsxv3.common.synchronization [req-3b967584-56b7-43fc-b8a2-03ea68955e56 req-1132af07-4cda-4c9a-a062-4617be0adc37 service nova] Enqueued Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_members [ 1236.201753] env[70520]: INFO networking_nsxv3.common.synchronization [req-3b967584-56b7-43fc-b8a2-03ea68955e56 req-1132af07-4cda-4c9a-a062-4617be0adc37 service nova] Enqueued Resource ID: dce39464-ac48-4034-9e86-7af7e94f49d1 with Priority: HIGHEST for action port [ 1236.206280] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_rules [ 1236.206280] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_members [ 1236.206280] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dce39464-ac48-4034-9e86-7af7e94f49d1 with Priority: HIGHEST for action port [ 1236.206280] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.206280] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.206280] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.206280] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.206280] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.206280] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.206280] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.206280] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.206280] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.206280] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.206280] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.206280] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.206280] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.208070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.208360] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.209568] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-dce39464-ac48-4034-9e86-7af7e94f49d1 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.209941] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dce39464-ac48-4034-9e86-7af7e94f49d1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.214792] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dce39464-ac48-4034-9e86-7af7e94f49d1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.214792] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dce39464-ac48-4034-9e86-7af7e94f49d1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.214792] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dce39464-ac48-4034-9e86-7af7e94f49d1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.511021] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.511021] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-557" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.511265] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-557" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.511604] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-557" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.511887] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.512507] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.512507] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.512507] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.512853] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.513111] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1236.513215] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1236.513331] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1236.513442] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1236.513558] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1236.513668] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1236.513811] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1236.544289] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1236.544457] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1236.544598] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1236.544827] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-557" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.545227] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-ecc38d37-ecac-415b-96e2-bda9fd6b730f taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.545404] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-ecc38d37-ecac-415b-96e2-bda9fd6b730f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.545526] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-ecc38d37-ecac-415b-96e2-bda9fd6b730f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.545883] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-ecc38d37-ecac-415b-96e2-bda9fd6b730f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.546030] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecc38d37-ecac-415b-96e2-bda9fd6b730f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.589337] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.589506] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.589603] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.590078] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.590078] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.590337] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.590492] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.590564] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.590807] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.590913] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.591512] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe already deleted. [ 1236.591512] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.706855] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa in Status: SUCCESS [ 1236.707135] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa deletion is rescheduled due to dependency. [ 1236.707135] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.716331] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.717474] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.717474] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.718552] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dce39464-ac48-4034-9e86-7af7e94f49d1 with status ACTIVE [ 1236.718552] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.718552] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.718552] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.718926] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.720685] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.721322] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.721515] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.721515] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.721897] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.721897] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.722661] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.722661] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.722661] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.723034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.723161] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.723748] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dce39464-ac48-4034-9e86-7af7e94f49d1 is going to be updated. [ 1236.746382] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: SUCCESS [ 1236.746700] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.746958] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.747278] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.747644] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.747786] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.747863] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.748075] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.748159] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.748245] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.748333] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.757413] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.757413] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.757413] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.757413] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.757413] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.757413] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dce39464-ac48-4034-9e86-7af7e94f49d1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.049176] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.049424] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.049555] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.049909] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.050087] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.050373] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port ecc38d37-ecac-415b-96e2-bda9fd6b730f not found, creating... [ 1237.050898] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.050994] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.051081] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.051321] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.051467] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.051781] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.051941] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.052086] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.052328] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.052488] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.052632] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: ecc38d37-ecac-415b-96e2-bda9fd6b730f is going to be created. [ 1237.074166] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.074498] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.074762] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.075166] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.075833] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.075833] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-ecc38d37-ecac-415b-96e2-bda9fd6b730f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.226386] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.250590] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.250866] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.250945] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.251261] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.251449] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.251607] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.251712] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.251960] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.252134] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.252322] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.252468] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.252583] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.252669] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.252943] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.253121] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.253243] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.253406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.253645] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.253775] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.254212] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.254385] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.729375] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.729573] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.729719] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.730018] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.730132] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.730254] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a is going to be updated. [ 1237.757398] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a927ecd-fa02-4905-9c80-5ef71a14a848: rpc.has_security_group_logging(os_id): False [ 1237.769508] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.769657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.769657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.769938] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.770092] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.780742] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.780885] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.780954] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.781177] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.781260] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.781962] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.782393] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.782526] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.782745] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.783070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.783461] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.783461] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.783592] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.783785] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.784245] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.784665] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.785135] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.785322] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.785501] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.785650] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.785890] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be updated. [ 1237.788641] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: IN_PROGRESS for 2s [ 1237.830876] env[70520]: INFO networking_nsxv3.common.synchronization [req-1cb6aeba-73fb-4519-bdcd-4f5df5682e62 req-66ffef28-0f5a-4fc5-99d3-f50a9b69fb47 service nova] Enqueued Resource ID: b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe with Priority: HIGHEST for action security_group_rules [ 1237.831095] env[70520]: INFO networking_nsxv3.common.synchronization [req-1cb6aeba-73fb-4519-bdcd-4f5df5682e62 req-66ffef28-0f5a-4fc5-99d3-f50a9b69fb47 service nova] Enqueued Resource ID: b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe with Priority: HIGHEST for action security_group_members [ 1237.831268] env[70520]: INFO networking_nsxv3.common.synchronization [req-1cb6aeba-73fb-4519-bdcd-4f5df5682e62 req-66ffef28-0f5a-4fc5-99d3-f50a9b69fb47 service nova] Enqueued Resource ID: ecc38d37-ecac-415b-96e2-bda9fd6b730f with Priority: HIGHEST for action port [ 1237.831549] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe with Priority: HIGHEST for action security_group_rules [ 1237.831677] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe with Priority: HIGHEST for action security_group_members [ 1237.831773] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecc38d37-ecac-415b-96e2-bda9fd6b730f with Priority: HIGHEST for action port [ 1237.833023] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.833097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.833173] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.833447] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.833532] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.836229] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.836229] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.836229] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.836229] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.836229] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.836229] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.836229] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.836229] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.836229] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.836515] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.842969] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecc38d37-ecac-415b-96e2-bda9fd6b730f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.843184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecc38d37-ecac-415b-96e2-bda9fd6b730f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.843184] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecc38d37-ecac-415b-96e2-bda9fd6b730f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.843473] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecc38d37-ecac-415b-96e2-bda9fd6b730f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.844027] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecc38d37-ecac-415b-96e2-bda9fd6b730f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.902062] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.902062] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.902062] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.902062] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.902062] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.939243] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: IN_PROGRESS for 2s [ 1237.989297] env[70520]: INFO networking_nsxv3.common.synchronization [req-6bac5e75-0798-4c1c-953d-492b735acc64 req-be6f89f3-d77f-4d66-ae91-47a5a8e9d46f tempest-ServerActionsTestJSON-420425725 tempest-ServerActionsTestJSON-420425725-project-member] Enqueued Resource ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c with Priority: HIGHEST for action security_group_members [ 1237.989297] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c with Priority: HIGHEST for action security_group_members [ 1237.990539] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d999f7b-50c9-40ee-b3b1-31ead407224c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.990931] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.991116] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.991419] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.991708] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.992068] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.992232] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.992492] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.994314] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.994314] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d999f7b-50c9-40ee-b3b1-31ead407224c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.347975] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ecc38d37-ecac-415b-96e2-bda9fd6b730f with status ACTIVE [ 1238.348332] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.348616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.348616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.348917] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.348988] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.349245] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.349459] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.349546] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.349851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.350110] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.350251] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.350476] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.350546] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.350750] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.350865] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.350987] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ecc38d37-ecac-415b-96e2-bda9fd6b730f is going to be updated. [ 1238.355372] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.355556] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.355854] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.385212] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.385374] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.385417] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.385623] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.385757] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.385993] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecc38d37-ecac-415b-96e2-bda9fd6b730f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.495983] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.496166] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.496221] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.497205] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.547434] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.548183] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.548183] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.548183] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.548472] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.548472] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.548472] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c is going to be updated. [ 1238.585848] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.586237] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.586237] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.586348] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.586449] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.598102] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c in Status: IN_PROGRESS for 2s [ 1238.861324] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.365954] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.365954] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.365954] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.365954] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.365954] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.365954] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe is going to be created. [ 1239.390405] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.391232] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.391351] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.391540] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.391709] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.404068] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe in Status: UNINITIALIZED for 2s [ 1239.800117] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: SUCCESS [ 1239.800343] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.800508] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.800733] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.800967] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.801101] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.801165] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.801324] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.801404] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.801490] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.801649] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.959415] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: SUCCESS [ 1239.959850] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.303747] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.303917] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.303988] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.304217] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.304388] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.304624] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.304624] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.304758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.304833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.304932] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.305541] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.305541] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.305541] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.305541] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.305541] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.305855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.305855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.305855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.305855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.305995] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.306042] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.610898] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c in Status: SUCCESS [ 1240.611201] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c deletion is rescheduled due to dependency. [ 1240.611290] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.808350] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d217c04a-3f61-40d6-89c2-a60cc7eb772a: rpc.has_security_group_logging(os_id): False [ 1240.827974] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.828461] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.828610] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.828844] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.828938] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.829177] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.829306] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.829381] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.829514] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.829590] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.829859] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.830047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.830107] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.830265] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.830340] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.830526] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.830614] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.831170] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.831170] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.831170] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.831170] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a is going to be updated. [ 1240.898195] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.898434] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.898434] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.898631] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.898780] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.919422] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: IN_PROGRESS for 2s [ 1241.414817] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe in Status: SUCCESS [ 1241.415103] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.415308] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.415536] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.415764] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.415924] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.416060] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.416327] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.416481] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.416635] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.416737] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.919398] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.919709] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.919788] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.920045] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.920222] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.920327] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.920386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.920628] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.920763] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.920881] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.921058] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.921173] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.921240] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.921403] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.922900] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.922900] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.922900] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.922900] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.923180] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.923180] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.923257] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.425972] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe: rpc.has_security_group_logging(os_id): False [ 1242.444231] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.444231] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.444231] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.444501] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.444501] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.444735] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.444800] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.444856] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.444992] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.445076] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.445339] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.445446] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.445506] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.445644] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.445718] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.445896] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.445987] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.446057] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.446193] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.446263] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.446345] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe is going to be created. [ 1242.504343] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.504577] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.504577] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.504771] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.504966] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.516144] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe in Status: IN_PROGRESS for 2s [ 1242.939484] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: SUCCESS [ 1242.939949] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.989987] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1242.990151] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1243.510954] env[70520]: INFO networking_nsxv3.common.synchronization [None req-11dff748-a823-4550-9f2e-35fbd3f21261 None None] Enqueued Resource ID: 39b1cf01-f25a-4c92-a485-81f51eb0c4d0 with Priority: HIGHEST for action port [ 1243.511239] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39b1cf01-f25a-4c92-a485-81f51eb0c4d0 with Priority: HIGHEST for action port [ 1243.511919] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-39b1cf01-f25a-4c92-a485-81f51eb0c4d0 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.512068] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39b1cf01-f25a-4c92-a485-81f51eb0c4d0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.512068] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39b1cf01-f25a-4c92-a485-81f51eb0c4d0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.512333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39b1cf01-f25a-4c92-a485-81f51eb0c4d0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.512384] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39b1cf01-f25a-4c92-a485-81f51eb0c4d0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.015048] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 39b1cf01-f25a-4c92-a485-81f51eb0c4d0 [ 1244.015503] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.015647] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.015719] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.015931] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.016080] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.016737] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:39b1cf01-f25a-4c92-a485-81f51eb0c4d0 already deleted. [ 1244.016906] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39b1cf01-f25a-4c92-a485-81f51eb0c4d0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.058856] env[70520]: INFO networking_nsxv3.common.synchronization [req-ac239872-b582-4b92-8f84-bc2aa33ba0b1 req-e0b6638b-308d-4fc5-a532-6abec42e4f11 tempest-AttachVolumeTestJSON-1760709661 tempest-AttachVolumeTestJSON-1760709661-project-member] Enqueued Resource ID: f112ebf4-d53d-408e-b028-a56b0ec3f4cb with Priority: HIGHEST for action security_group_members [ 1244.059390] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f112ebf4-d53d-408e-b028-a56b0ec3f4cb with Priority: HIGHEST for action security_group_members [ 1244.059713] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f112ebf4-d53d-408e-b028-a56b0ec3f4cb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.059861] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.059932] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.068851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.069109] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.069243] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.069312] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.069491] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.069577] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.069691] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f112ebf4-d53d-408e-b028-a56b0ec3f4cb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.072497] env[70520]: INFO networking_nsxv3.common.synchronization [None req-906aa185-e59a-4b72-bd25-a48e2eea7c68 tempest-AttachInterfacesUnderV243Test-1671143301 tempest-AttachInterfacesUnderV243Test-1671143301-project-member] Enqueued Resource ID: 16364084-cf78-49e0-9024-a052945a9e8d with Priority: HIGHEST for action security_group_rules [ 1244.073432] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16364084-cf78-49e0-9024-a052945a9e8d with Priority: HIGHEST for action security_group_rules [ 1244.073537] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16364084-cf78-49e0-9024-a052945a9e8d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.073633] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.073633] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.073823] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.073889] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16364084-cf78-49e0-9024-a052945a9e8d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.172630] env[70520]: INFO networking_nsxv3.common.synchronization [None req-f007e564-3783-4ff1-8232-080bd667cb73 tempest-AttachInterfacesUnderV243Test-1671143301 tempest-AttachInterfacesUnderV243Test-1671143301-project-member] Enqueued Resource ID: 16364084-cf78-49e0-9024-a052945a9e8d with Priority: HIGHEST for action security_group_rules [ 1244.172630] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16364084-cf78-49e0-9024-a052945a9e8d with Priority: HIGHEST for action security_group_rules [ 1244.172630] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16364084-cf78-49e0-9024-a052945a9e8d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.172630] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.529326] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe in Status: SUCCESS [ 1244.529582] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.553544] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-356 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.557141] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-356" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.557141] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-356" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.557141] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-356" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.560769] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.560769] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.560769] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.560769] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.560769] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.560769] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1244.560769] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1244.560769] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1244.560769] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1244.560769] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1244.560769] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1244.560769] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1244.573349] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.573693] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.573693] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.573807] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.573865] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.574049] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.574157] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.574210] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.574356] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.574429] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.574515] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f112ebf4-d53d-408e-b028-a56b0ec3f4cb already deleted. [ 1244.574592] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.577691] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1244.578501] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1244.578501] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1244.578501] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-356" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.578951] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-a77a38b6-9c84-4ce7-aeae-165922f32804 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.578951] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-a77a38b6-9c84-4ce7-aeae-165922f32804" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.578951] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-a77a38b6-9c84-4ce7-aeae-165922f32804" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.579268] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-a77a38b6-9c84-4ce7-aeae-165922f32804" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.579405] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a77a38b6-9c84-4ce7-aeae-165922f32804',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.599595] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.599595] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.599595] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.599793] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.599793] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.599855] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16364084-cf78-49e0-9024-a052945a9e8d already deleted. [ 1244.599968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.600484] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.601925] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.601925] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16364084-cf78-49e0-9024-a052945a9e8d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.088022] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.088022] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.088022] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.088022] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.088022] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.088022] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port a77a38b6-9c84-4ce7-aeae-165922f32804 not found, creating... [ 1245.088022] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.088022] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.088022] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.088022] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.088022] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.088806] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.088806] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.088806] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.088806] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.088806] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.088806] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: a77a38b6-9c84-4ce7-aeae-165922f32804 is going to be created. [ 1245.119726] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.120859] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.121313] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.121778] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.122141] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.122506] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-a77a38b6-9c84-4ce7-aeae-165922f32804" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.125081] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.127979] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.128119] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.128361] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.128474] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.128609] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16364084-cf78-49e0-9024-a052945a9e8d already deleted. [ 1245.128730] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.625536] env[70520]: INFO networking_nsxv3.common.synchronization [req-6cb1a1e6-7011-463e-87b1-2a49db7e09a2 req-16443802-d3d6-42d7-b2b4-6e38f70c9949 tempest-ServersTestJSON-589199853 tempest-ServersTestJSON-589199853-project-member] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1245.626117] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1245.626428] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.626986] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.627136] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.627350] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.627503] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.627599] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.627660] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.627823] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.627934] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.628039] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.865379] env[70520]: INFO networking_nsxv3.common.synchronization [req-ac239872-b582-4b92-8f84-bc2aa33ba0b1 req-01048bc8-efd4-44e6-ad0d-8c449eaf206e service nova] Enqueued Resource ID: f112ebf4-d53d-408e-b028-a56b0ec3f4cb with Priority: HIGHEST for action security_group_rules [ 1245.865620] env[70520]: INFO networking_nsxv3.common.synchronization [req-ac239872-b582-4b92-8f84-bc2aa33ba0b1 req-01048bc8-efd4-44e6-ad0d-8c449eaf206e service nova] Enqueued Resource ID: f112ebf4-d53d-408e-b028-a56b0ec3f4cb with Priority: HIGHEST for action security_group_members [ 1245.865781] env[70520]: INFO networking_nsxv3.common.synchronization [req-ac239872-b582-4b92-8f84-bc2aa33ba0b1 req-01048bc8-efd4-44e6-ad0d-8c449eaf206e service nova] Enqueued Resource ID: a77a38b6-9c84-4ce7-aeae-165922f32804 with Priority: HIGHEST for action port [ 1245.868114] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f112ebf4-d53d-408e-b028-a56b0ec3f4cb with Priority: HIGHEST for action security_group_rules [ 1245.868114] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f112ebf4-d53d-408e-b028-a56b0ec3f4cb with Priority: HIGHEST for action security_group_members [ 1245.868114] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a77a38b6-9c84-4ce7-aeae-165922f32804 with Priority: HIGHEST for action port [ 1245.868114] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f112ebf4-d53d-408e-b028-a56b0ec3f4cb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.868114] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.868114] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.868114] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.868114] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f112ebf4-d53d-408e-b028-a56b0ec3f4cb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.868497] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f112ebf4-d53d-408e-b028-a56b0ec3f4cb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.868617] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.868682] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.869110] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.869110] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.869110] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.869347] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.869347] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.869462] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.869588] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f112ebf4-d53d-408e-b028-a56b0ec3f4cb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.870457] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-a77a38b6-9c84-4ce7-aeae-165922f32804 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.870570] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a77a38b6-9c84-4ce7-aeae-165922f32804" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.870622] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a77a38b6-9c84-4ce7-aeae-165922f32804" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.870810] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a77a38b6-9c84-4ce7-aeae-165922f32804" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.870852] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a77a38b6-9c84-4ce7-aeae-165922f32804',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.016173] env[70520]: INFO networking_nsxv3.common.synchronization [None req-78e2ffe4-996c-4823-9117-3dacbc3ac78e None None] Enqueued Resource ID: 8eae654e-02a5-42e3-8e89-4a88efff531d with Priority: HIGHEST for action port [ 1246.016737] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8eae654e-02a5-42e3-8e89-4a88efff531d with Priority: HIGHEST for action port [ 1246.017079] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-8eae654e-02a5-42e3-8e89-4a88efff531d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.017214] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8eae654e-02a5-42e3-8e89-4a88efff531d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.017282] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8eae654e-02a5-42e3-8e89-4a88efff531d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.017550] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8eae654e-02a5-42e3-8e89-4a88efff531d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.017629] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8eae654e-02a5-42e3-8e89-4a88efff531d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.131810] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.375673] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f112ebf4-d53d-408e-b028-a56b0ec3f4cb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.376782] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f112ebf4-d53d-408e-b028-a56b0ec3f4cb taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.376919] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.377113] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a77a38b6-9c84-4ce7-aeae-165922f32804 with status ACTIVE [ 1246.377283] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.377401] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.377466] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.377719] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.377851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.378061] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.378173] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.378236] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.378484] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.378565] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.378744] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.378835] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.378895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.379620] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.380011] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.380894] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a77a38b6-9c84-4ce7-aeae-165922f32804 is going to be updated. [ 1246.406730] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.406895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.406964] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.411020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.411020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.411020] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a77a38b6-9c84-4ce7-aeae-165922f32804" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.520136] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8eae654e-02a5-42e3-8e89-4a88efff531d [ 1246.520541] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.520721] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.520816] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.521143] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.521289] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.521436] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8eae654e-02a5-42e3-8e89-4a88efff531d already deleted. [ 1246.521557] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8eae654e-02a5-42e3-8e89-4a88efff531d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.634461] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.882025] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f112ebf4-d53d-408e-b028-a56b0ec3f4cb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.138146] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.138553] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.138553] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.138632] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.138689] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.138796] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be updated. [ 1247.171042] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.171042] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.171042] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.171310] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.171310] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.180394] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: IN_PROGRESS for 2s [ 1247.384842] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.385136] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.385284] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.385639] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.385822] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.386010] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f112ebf4-d53d-408e-b028-a56b0ec3f4cb is going to be created. [ 1247.417251] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.417464] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.417464] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.417727] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.417982] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.428861] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f112ebf4-d53d-408e-b028-a56b0ec3f4cb in Status: UNINITIALIZED for 2s [ 1249.190411] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: SUCCESS [ 1249.190411] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.441095] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f112ebf4-d53d-408e-b028-a56b0ec3f4cb in Status: SUCCESS [ 1249.441332] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.441550] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.441813] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.442046] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.442210] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.442285] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.442486] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.442571] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.443303] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.443435] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f112ebf4-d53d-408e-b028-a56b0ec3f4cb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.947738] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f112ebf4-d53d-408e-b028-a56b0ec3f4cb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.093109] env[70520]: INFO networking_nsxv3.common.synchronization [req-d347672a-3ae8-4f40-851e-b597ae66d812 req-411168e4-9fff-47d8-853d-9e17b050e2ff tempest-AttachInterfacesUnderV243Test-1671143301 tempest-AttachInterfacesUnderV243Test-1671143301-project-member] Enqueued Resource ID: 16364084-cf78-49e0-9024-a052945a9e8d with Priority: HIGHEST for action security_group_members [ 1250.093283] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16364084-cf78-49e0-9024-a052945a9e8d with Priority: HIGHEST for action security_group_members [ 1250.095188] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-16364084-cf78-49e0-9024-a052945a9e8d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.095188] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.095188] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.095188] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.095188] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.095188] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.095188] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.095188] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.095188] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.095188] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16364084-cf78-49e0-9024-a052945a9e8d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.450037] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f112ebf4-d53d-408e-b028-a56b0ec3f4cb: rpc.has_security_group_logging(os_id): False [ 1250.472206] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.472386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.472433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.472704] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.472835] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.473126] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.473250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.473314] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.473530] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.473629] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.473722] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f112ebf4-d53d-408e-b028-a56b0ec3f4cb is going to be created. [ 1250.581600] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.581847] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.581963] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.582235] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.582481] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.596611] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f112ebf4-d53d-408e-b028-a56b0ec3f4cb in Status: IN_PROGRESS for 2s [ 1250.597114] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.597308] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.597425] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.597689] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.597851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.598113] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.598298] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.598401] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.598638] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.598762] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.598904] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16364084-cf78-49e0-9024-a052945a9e8d already deleted. [ 1250.599189] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.602134] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-206 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.602458] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-206" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.602594] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-206" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.602910] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-206" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.603196] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.603420] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.603612] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.603918] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.604516] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.604647] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1250.604837] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1250.604998] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1250.605132] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1250.605282] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1250.605434] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1250.605617] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1250.640579] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1250.640759] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1250.640759] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1250.641079] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-206" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.641521] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-abb0f8fe-574b-4c31-a490-168df1f888f7 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.641800] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-abb0f8fe-574b-4c31-a490-168df1f888f7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.641946] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-abb0f8fe-574b-4c31-a490-168df1f888f7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.642417] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-abb0f8fe-574b-4c31-a490-168df1f888f7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.642572] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abb0f8fe-574b-4c31-a490-168df1f888f7',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.145657] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.145976] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.146083] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.146315] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.146472] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.146628] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port abb0f8fe-574b-4c31-a490-168df1f888f7 not found, creating... [ 1251.146892] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.147060] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.147179] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.147396] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.147534] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.147810] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.148009] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.148135] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.148342] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.148475] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.148612] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: abb0f8fe-574b-4c31-a490-168df1f888f7 is going to be created. [ 1251.169262] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.169493] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.169621] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.169960] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.170218] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.170445] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-abb0f8fe-574b-4c31-a490-168df1f888f7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.028638] env[70520]: INFO networking_nsxv3.common.synchronization [req-d347672a-3ae8-4f40-851e-b597ae66d812 req-b2f4e59d-dee8-4410-af0f-ae4dc24ac53c service nova] Enqueued Resource ID: 16364084-cf78-49e0-9024-a052945a9e8d with Priority: HIGHEST for action security_group_rules [ 1252.029505] env[70520]: INFO networking_nsxv3.common.synchronization [req-d347672a-3ae8-4f40-851e-b597ae66d812 req-b2f4e59d-dee8-4410-af0f-ae4dc24ac53c service nova] Enqueued Resource ID: 16364084-cf78-49e0-9024-a052945a9e8d with Priority: HIGHEST for action security_group_members [ 1252.029505] env[70520]: INFO networking_nsxv3.common.synchronization [req-d347672a-3ae8-4f40-851e-b597ae66d812 req-b2f4e59d-dee8-4410-af0f-ae4dc24ac53c service nova] Enqueued Resource ID: abb0f8fe-574b-4c31-a490-168df1f888f7 with Priority: HIGHEST for action port [ 1252.032474] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16364084-cf78-49e0-9024-a052945a9e8d with Priority: HIGHEST for action security_group_rules [ 1252.035431] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16364084-cf78-49e0-9024-a052945a9e8d with Priority: HIGHEST for action security_group_members [ 1252.035431] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abb0f8fe-574b-4c31-a490-168df1f888f7 with Priority: HIGHEST for action port [ 1252.035431] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16364084-cf78-49e0-9024-a052945a9e8d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.035431] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.035431] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.035431] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.035431] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16364084-cf78-49e0-9024-a052945a9e8d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.035431] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-16364084-cf78-49e0-9024-a052945a9e8d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.035781] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.035781] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.036403] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.036730] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.036877] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.036929] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.037125] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.037327] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.037434] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16364084-cf78-49e0-9024-a052945a9e8d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.038528] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-abb0f8fe-574b-4c31-a490-168df1f888f7 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.038528] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abb0f8fe-574b-4c31-a490-168df1f888f7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.038528] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abb0f8fe-574b-4c31-a490-168df1f888f7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.038700] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abb0f8fe-574b-4c31-a490-168df1f888f7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.038700] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abb0f8fe-574b-4c31-a490-168df1f888f7',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.222644] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-631 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.222842] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.222968] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.223271] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.223531] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.223690] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.223808] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.224050] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.224253] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.224437] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1252.224521] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1252.224615] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1252.224725] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1252.224834] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1252.224942] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1252.225092] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1252.250109] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1252.250109] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1252.250109] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1252.250109] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-631" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.250109] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-dce39464-ac48-4034-9e86-7af7e94f49d1 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.250109] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-dce39464-ac48-4034-9e86-7af7e94f49d1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.250109] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-dce39464-ac48-4034-9e86-7af7e94f49d1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.250109] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-dce39464-ac48-4034-9e86-7af7e94f49d1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.250109] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dce39464-ac48-4034-9e86-7af7e94f49d1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.541555] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port abb0f8fe-574b-4c31-a490-168df1f888f7 with status ACTIVE [ 1252.541831] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.541998] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.542117] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.542359] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.542465] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.542645] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.542793] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.543445] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.543445] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.543445] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.543445] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.544555] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.544555] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.544555] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.544555] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.544555] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: abb0f8fe-574b-4c31-a490-168df1f888f7 is going to be updated. [ 1252.545123] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16364084-cf78-49e0-9024-a052945a9e8d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.546052] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-16364084-cf78-49e0-9024-a052945a9e8d taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.546173] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.566656] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.566825] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.566894] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.567152] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.567313] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.567478] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abb0f8fe-574b-4c31-a490-168df1f888f7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.610411] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f112ebf4-d53d-408e-b028-a56b0ec3f4cb in Status: SUCCESS [ 1252.610411] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.753527] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.753527] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.753754] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.754337] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.754337] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.754337] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.754522] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.754630] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.754856] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.754997] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.755301] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.755457] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.755574] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.755793] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.755920] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.756077] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: dce39464-ac48-4034-9e86-7af7e94f49d1 is going to be updated. [ 1252.780663] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.781019] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.781203] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.781491] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.781691] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.781931] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-dce39464-ac48-4034-9e86-7af7e94f49d1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.048271] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16364084-cf78-49e0-9024-a052945a9e8d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.140208] env[70520]: INFO networking_nsxv3.common.synchronization [req-639a8938-877f-40db-842c-cdbc78efc5e4 req-daf10448-64de-41c1-931b-355d5f557cfc tempest-ServerMetadataTestJSON-1315216060 tempest-ServerMetadataTestJSON-1315216060-project-member] Enqueued Resource ID: b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe with Priority: HIGHEST for action security_group_members [ 1253.140347] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe with Priority: HIGHEST for action security_group_members [ 1253.140536] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.141179] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.141353] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.141753] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.142058] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.142676] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.142772] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.142983] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.143144] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.143469] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.528515] env[70520]: INFO networking_nsxv3.common.synchronization [req-eb16cd8a-08a1-4f85-a7e9-2e88b6ec82ac req-13bfc2b1-9200-4ab8-a0b9-78492c175e98 service nova] Enqueued Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_rules [ 1253.529494] env[70520]: INFO networking_nsxv3.common.synchronization [req-eb16cd8a-08a1-4f85-a7e9-2e88b6ec82ac req-13bfc2b1-9200-4ab8-a0b9-78492c175e98 service nova] Enqueued Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_members [ 1253.530473] env[70520]: INFO networking_nsxv3.common.synchronization [req-eb16cd8a-08a1-4f85-a7e9-2e88b6ec82ac req-13bfc2b1-9200-4ab8-a0b9-78492c175e98 service nova] Enqueued Resource ID: dce39464-ac48-4034-9e86-7af7e94f49d1 with Priority: HIGHEST for action port [ 1253.531460] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_rules [ 1253.531615] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_members [ 1253.531716] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dce39464-ac48-4034-9e86-7af7e94f49d1 with Priority: HIGHEST for action port [ 1253.534028] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.534028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.534028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.534028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.534028] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.534028] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.534286] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.534286] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.534345] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.534473] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.535275] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.535275] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.535275] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.535275] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.535275] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.535662] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-dce39464-ac48-4034-9e86-7af7e94f49d1 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.535763] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dce39464-ac48-4034-9e86-7af7e94f49d1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.535820] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dce39464-ac48-4034-9e86-7af7e94f49d1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.535969] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dce39464-ac48-4034-9e86-7af7e94f49d1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.536641] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dce39464-ac48-4034-9e86-7af7e94f49d1',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.558247] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.558421] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.558502] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.558806] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.558924] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.559037] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16364084-cf78-49e0-9024-a052945a9e8d is going to be created. [ 1253.585478] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.585627] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.585688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.585991] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.586112] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.595212] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16364084-cf78-49e0-9024-a052945a9e8d in Status: UNINITIALIZED for 2s [ 1253.645853] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.646058] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.646123] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.646330] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.646422] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.646747] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.646747] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.646859] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.646945] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.646996] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.647090] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe is going to be updated. [ 1253.680122] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.680282] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.680343] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.680527] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.680687] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.690136] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe in Status: IN_PROGRESS for 2s [ 1254.039038] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dce39464-ac48-4034-9e86-7af7e94f49d1 with status ACTIVE [ 1254.039470] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.039470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.039774] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.039860] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.040551] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.040712] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.040840] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.040941] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.042202] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.042202] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.042202] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.042202] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.042202] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.042202] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.042202] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.042202] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dce39464-ac48-4034-9e86-7af7e94f49d1 is going to be updated. [ 1254.044448] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.045567] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.045718] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.068547] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.068547] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.068979] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.068979] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.069176] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.069317] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dce39464-ac48-4034-9e86-7af7e94f49d1" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.202631] env[70520]: INFO networking_nsxv3.common.synchronization [req-21d6dbc4-8dd3-4b10-940b-5730926fb55b req-5e5b4829-6980-4e7c-a4d3-c0b07edf0449 tempest-ServerActionsTestJSON-420425725 tempest-ServerActionsTestJSON-420425725-project-member] Enqueued Resource ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c with Priority: HIGHEST for action security_group_members [ 1254.202631] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c with Priority: HIGHEST for action security_group_members [ 1254.202631] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d999f7b-50c9-40ee-b3b1-31ead407224c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.202781] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.202781] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.202979] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.203317] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.203436] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.203475] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.203636] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.203715] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.203803] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d999f7b-50c9-40ee-b3b1-31ead407224c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.540182] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-135 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.540182] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-135" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.540182] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-135" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.540182] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-135" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.540182] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.540182] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.540182] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.540182] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.540182] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.541876] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1254.541876] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1254.541876] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1254.541876] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1254.541876] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1254.541876] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1254.541876] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1254.548321] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.561690] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1254.562568] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1254.562801] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1254.563042] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-135" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.563538] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-22f32c88-ed2a-4218-a06a-cd05828d6663 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.563860] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-22f32c88-ed2a-4218-a06a-cd05828d6663" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.563932] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-22f32c88-ed2a-4218-a06a-cd05828d6663" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.564269] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-22f32c88-ed2a-4218-a06a-cd05828d6663" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.564455] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22f32c88-ed2a-4218-a06a-cd05828d6663',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.706215] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.706368] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.706446] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.706670] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.706749] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.707109] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.707272] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.707347] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.707516] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.707670] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.707717] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c is going to be updated. [ 1254.733624] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.733814] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.733877] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.734177] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.734377] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.744026] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c in Status: IN_PROGRESS for 2s [ 1255.051063] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.051063] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.051177] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.051381] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.051487] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.051608] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a is going to be updated. [ 1255.067327] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.067524] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.067648] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.067989] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.068194] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.068380] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 22f32c88-ed2a-4218-a06a-cd05828d6663 not found, creating... [ 1255.068703] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.069043] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.069152] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.069460] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.069693] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.070167] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.070286] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.070457] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.070733] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.070906] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.071304] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 22f32c88-ed2a-4218-a06a-cd05828d6663 is going to be created. [ 1255.082775] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.082972] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.083070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.083351] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.083582] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.092824] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: IN_PROGRESS for 2s [ 1255.094269] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.094523] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.094655] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.094964] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.095245] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.095491] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-22f32c88-ed2a-4218-a06a-cd05828d6663" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.612104] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16364084-cf78-49e0-9024-a052945a9e8d in Status: SUCCESS [ 1255.612299] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.612462] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.612727] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.613030] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.613164] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.613245] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.613436] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.614067] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.614067] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.614067] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16364084-cf78-49e0-9024-a052945a9e8d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.702093] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe in Status: SUCCESS [ 1255.702523] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe deletion is rescheduled due to dependency. [ 1255.702672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.854405] env[70520]: INFO networking_nsxv3.common.synchronization [req-21d6dbc4-8dd3-4b10-940b-5730926fb55b req-867a1089-4a76-42ab-8502-4de112c32574 service nova] Enqueued Resource ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c with Priority: HIGHEST for action security_group_rules [ 1255.854591] env[70520]: INFO networking_nsxv3.common.synchronization [req-21d6dbc4-8dd3-4b10-940b-5730926fb55b req-867a1089-4a76-42ab-8502-4de112c32574 service nova] Enqueued Resource ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c with Priority: HIGHEST for action security_group_members [ 1255.854734] env[70520]: INFO networking_nsxv3.common.synchronization [req-21d6dbc4-8dd3-4b10-940b-5730926fb55b req-867a1089-4a76-42ab-8502-4de112c32574 service nova] Enqueued Resource ID: 22f32c88-ed2a-4218-a06a-cd05828d6663 with Priority: HIGHEST for action port [ 1255.854977] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c with Priority: HIGHEST for action security_group_rules [ 1255.855132] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c with Priority: HIGHEST for action security_group_members [ 1255.855228] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22f32c88-ed2a-4218-a06a-cd05828d6663 with Priority: HIGHEST for action port [ 1255.855865] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d999f7b-50c9-40ee-b3b1-31ead407224c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.856016] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.856080] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.856371] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.856489] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d999f7b-50c9-40ee-b3b1-31ead407224c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.857814] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d999f7b-50c9-40ee-b3b1-31ead407224c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.857892] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.858122] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-22f32c88-ed2a-4218-a06a-cd05828d6663 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.858229] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22f32c88-ed2a-4218-a06a-cd05828d6663" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.858293] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22f32c88-ed2a-4218-a06a-cd05828d6663" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.858514] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22f32c88-ed2a-4218-a06a-cd05828d6663" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.858591] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22f32c88-ed2a-4218-a06a-cd05828d6663',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.116302] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16364084-cf78-49e0-9024-a052945a9e8d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.360742] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d999f7b-50c9-40ee-b3b1-31ead407224c taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.360903] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.362493] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 22f32c88-ed2a-4218-a06a-cd05828d6663 with status ACTIVE [ 1256.362907] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.362907] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.362907] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.363384] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.363384] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.363384] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.363487] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.363558] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.363721] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.363800] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.363995] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.364119] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.364175] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.364321] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.364410] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.364500] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 22f32c88-ed2a-4218-a06a-cd05828d6663 is going to be updated. [ 1256.393793] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.393958] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.394041] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.394287] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.394377] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.394538] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22f32c88-ed2a-4218-a06a-cd05828d6663" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.618462] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16364084-cf78-49e0-9024-a052945a9e8d: rpc.has_security_group_logging(os_id): False [ 1256.645948] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.646157] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.646263] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.646517] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.646627] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.646898] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.646994] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.647069] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.647228] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.647304] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.647393] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16364084-cf78-49e0-9024-a052945a9e8d is going to be created. [ 1256.716949] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.717470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.717470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.717662] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.717967] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.730986] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16364084-cf78-49e0-9024-a052945a9e8d in Status: IN_PROGRESS for 2s [ 1256.753425] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c in Status: SUCCESS [ 1256.753585] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c deletion is rescheduled due to dependency. [ 1256.753725] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.753917] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.755820] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.755820] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.755820] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.755820] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.755820] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.755820] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.755820] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d999f7b-50c9-40ee-b3b1-31ead407224c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.102528] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: SUCCESS [ 1257.102747] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.102908] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.103192] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.103395] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.103566] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.103641] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.103798] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.103879] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.103965] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.104107] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.258628] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d999f7b-50c9-40ee-b3b1-31ead407224c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.606093] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.606308] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.606402] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.606620] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.606786] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.606895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.607044] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.607121] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.607211] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.607297] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.607442] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.607532] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.607591] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.607726] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.607877] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.607975] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.608047] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.608185] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.608259] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.608339] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.608422] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.761034] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d999f7b-50c9-40ee-b3b1-31ead407224c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.111734] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d217c04a-3f61-40d6-89c2-a60cc7eb772a: rpc.has_security_group_logging(os_id): False [ 1258.138039] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.138039] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.138226] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.138337] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.138423] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.138611] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.138906] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.138906] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.138906] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.139112] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.139171] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.139271] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.139325] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.139462] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.139532] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.139705] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.139794] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.139860] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.140051] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.140146] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.140233] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a is going to be updated. [ 1258.208387] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.208528] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.208599] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.208963] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.209131] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.229825] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: IN_PROGRESS for 2s [ 1258.264531] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.264939] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.264939] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.265055] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.265139] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.265286] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c is going to be updated. [ 1258.305755] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.305755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.305755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.305755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.305755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.314888] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c in Status: IN_PROGRESS for 2s [ 1258.742239] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16364084-cf78-49e0-9024-a052945a9e8d in Status: SUCCESS [ 1258.742471] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.811028] env[70520]: INFO networking_nsxv3.common.synchronization [req-64874b89-eb52-4b06-9424-463a72afc4f5 req-b6fb9173-a0b4-487c-9a6d-f6a4176ff6c6 tempest-ServersTestJSON-589199853 tempest-ServersTestJSON-589199853-project-member] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1258.811554] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1258.811851] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.811973] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.812053] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.812297] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.812547] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.812547] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.812668] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.812747] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.812829] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.812918] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.160581] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-831 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.160852] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-831" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.160989] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-831" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.161305] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-831" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.161582] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.161745] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.161865] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.162495] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.162495] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.162737] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1259.162737] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1259.162822] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1259.162937] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1259.163072] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1259.163196] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1259.163362] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1259.188608] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1259.188789] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1259.188944] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1259.189199] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-831" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.189530] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-c55d2b9c-6d7c-4b40-a43e-4d940a61e88f taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.189706] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-c55d2b9c-6d7c-4b40-a43e-4d940a61e88f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.189827] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-c55d2b9c-6d7c-4b40-a43e-4d940a61e88f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.190291] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-c55d2b9c-6d7c-4b40-a43e-4d940a61e88f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.190493] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c55d2b9c-6d7c-4b40-a43e-4d940a61e88f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.318817] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.693269] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.693510] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.693640] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.693947] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.694128] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.694290] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port c55d2b9c-6d7c-4b40-a43e-4d940a61e88f not found, creating... [ 1259.694567] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.694729] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.694850] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.695098] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.695245] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.695573] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.695750] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.695869] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.696101] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.696244] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.696388] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: c55d2b9c-6d7c-4b40-a43e-4d940a61e88f is going to be created. [ 1259.716955] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.717213] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.717392] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.717718] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.718131] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.718513] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-c55d2b9c-6d7c-4b40-a43e-4d940a61e88f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.821440] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.245051] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: SUCCESS [ 1260.245297] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.324853] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.325220] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.325220] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.325408] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.325503] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.325606] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be updated. [ 1260.327392] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c in Status: SUCCESS [ 1260.327587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.327746] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.327937] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.328554] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.328669] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.328730] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.329031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.329132] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.329222] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.329312] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d999f7b-50c9-40ee-b3b1-31ead407224c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.359186] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.359407] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.359407] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.359613] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.359753] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.369840] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: IN_PROGRESS for 2s [ 1260.832460] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d999f7b-50c9-40ee-b3b1-31ead407224c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.318256] env[70520]: INFO networking_nsxv3.common.synchronization [req-64874b89-eb52-4b06-9424-463a72afc4f5 req-51532c23-fdc6-4880-a5d5-8851de4c7c08 service nova] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_rules [ 1261.318587] env[70520]: INFO networking_nsxv3.common.synchronization [req-64874b89-eb52-4b06-9424-463a72afc4f5 req-51532c23-fdc6-4880-a5d5-8851de4c7c08 service nova] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1261.318780] env[70520]: INFO networking_nsxv3.common.synchronization [req-64874b89-eb52-4b06-9424-463a72afc4f5 req-51532c23-fdc6-4880-a5d5-8851de4c7c08 service nova] Enqueued Resource ID: c55d2b9c-6d7c-4b40-a43e-4d940a61e88f with Priority: HIGHEST for action port [ 1261.322818] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_rules [ 1261.322818] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1261.322818] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c55d2b9c-6d7c-4b40-a43e-4d940a61e88f with Priority: HIGHEST for action port [ 1261.322818] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.322818] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.322818] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.322818] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.322818] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.322818] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.322818] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.322818] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-c55d2b9c-6d7c-4b40-a43e-4d940a61e88f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.322818] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c55d2b9c-6d7c-4b40-a43e-4d940a61e88f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.322818] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c55d2b9c-6d7c-4b40-a43e-4d940a61e88f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.322818] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c55d2b9c-6d7c-4b40-a43e-4d940a61e88f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.322818] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c55d2b9c-6d7c-4b40-a43e-4d940a61e88f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.334235] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d999f7b-50c9-40ee-b3b1-31ead407224c: rpc.has_security_group_logging(os_id): False [ 1261.352840] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.352977] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.353056] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.353265] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.353391] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.353591] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.353689] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.353896] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.353896] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.354036] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.354087] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c is going to be updated. [ 1261.413772] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.413920] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.413992] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.414214] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.414361] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.426748] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c in Status: IN_PROGRESS for 2s [ 1261.826515] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.826699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.826940] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c55d2b9c-6d7c-4b40-a43e-4d940a61e88f with status ACTIVE [ 1261.827175] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.827351] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.827466] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.827765] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.827938] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.828316] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.828549] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.828616] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.828828] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.828925] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.829280] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.829280] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.829418] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.829462] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.829528] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.829630] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c55d2b9c-6d7c-4b40-a43e-4d940a61e88f is going to be updated. [ 1261.851815] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.851920] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.852518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.852518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.852518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.852838] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c55d2b9c-6d7c-4b40-a43e-4d940a61e88f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.382196] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: SUCCESS [ 1262.382546] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.382546] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.382811] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.383040] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.383216] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.383276] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.383443] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.383544] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.383659] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.886662] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.922133] env[70520]: INFO networking_nsxv3.common.synchronization [req-da62d0c0-64a1-4241-b840-adf04fc84b7b req-af2e1a96-11b4-470c-9ce2-d287d0510135 tempest-ServerActionsTestOtherA-325270290 tempest-ServerActionsTestOtherA-325270290-project-member] Enqueued Resource ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 with Priority: HIGHEST for action security_group_members [ 1262.922133] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 with Priority: HIGHEST for action security_group_members [ 1262.922133] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fc21783-a665-46f8-bdde-7d13f7923e03 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.922133] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.922133] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.922133] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.922637] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.922637] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.922637] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.922637] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.922637] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.922803] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fc21783-a665-46f8-bdde-7d13f7923e03',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.204618] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-572 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.204860] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-572" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.204952] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-572" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.205244] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-572" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.205505] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.205654] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.205774] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.206039] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.206349] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.206570] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1263.206684] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1263.206792] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1263.206897] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1263.207016] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1263.207134] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1263.207266] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1263.227851] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1263.228068] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1263.228217] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1263.228399] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-572" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.228717] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-0a0268a9-f4a9-474b-a951-1c43b40ac331 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.228894] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-0a0268a9-f4a9-474b-a951-1c43b40ac331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.229031] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-0a0268a9-f4a9-474b-a951-1c43b40ac331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.229379] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-0a0268a9-f4a9-474b-a951-1c43b40ac331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.229553] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a0268a9-f4a9-474b-a951-1c43b40ac331',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.389253] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.424362] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0fc21783-a665-46f8-bdde-7d13f7923e03',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.440019] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c in Status: SUCCESS [ 1263.440379] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.731877] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.732138] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.732307] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.732614] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.732781] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.732941] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 0a0268a9-f4a9-474b-a951-1c43b40ac331 not found, creating... [ 1263.733232] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.733397] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.733526] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.733809] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.733962] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.734300] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.734490] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.734618] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.734867] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.735017] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.735171] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 0a0268a9-f4a9-474b-a951-1c43b40ac331 is going to be created. [ 1263.755953] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.756187] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.756316] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.756584] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.756814] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.757086] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-0a0268a9-f4a9-474b-a951-1c43b40ac331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.892280] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.892510] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.892608] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.892892] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.893019] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.893156] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be updated. [ 1263.926717] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0fc21783-a665-46f8-bdde-7d13f7923e03',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.952550] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.952791] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.952791] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.952869] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.953042] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.962144] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: IN_PROGRESS for 2s [ 1264.430768] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.431085] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.431149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.431505] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.431663] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.431830] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 is going to be updated. [ 1264.466661] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.466937] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.467068] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.467306] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.467477] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.480067] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 in Status: IN_PROGRESS for 2s [ 1264.653109] env[70520]: INFO networking_nsxv3.common.synchronization [req-da62d0c0-64a1-4241-b840-adf04fc84b7b req-220ac74f-e77e-45ab-830f-74ac74fe8fc6 service nova] Enqueued Resource ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 with Priority: HIGHEST for action security_group_rules [ 1264.653341] env[70520]: INFO networking_nsxv3.common.synchronization [req-da62d0c0-64a1-4241-b840-adf04fc84b7b req-220ac74f-e77e-45ab-830f-74ac74fe8fc6 service nova] Enqueued Resource ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 with Priority: HIGHEST for action security_group_members [ 1264.653561] env[70520]: INFO networking_nsxv3.common.synchronization [req-da62d0c0-64a1-4241-b840-adf04fc84b7b req-220ac74f-e77e-45ab-830f-74ac74fe8fc6 service nova] Enqueued Resource ID: 0a0268a9-f4a9-474b-a951-1c43b40ac331 with Priority: HIGHEST for action port [ 1264.654155] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 with Priority: HIGHEST for action security_group_rules [ 1264.654294] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 with Priority: HIGHEST for action security_group_members [ 1264.654396] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a0268a9-f4a9-474b-a951-1c43b40ac331 with Priority: HIGHEST for action port [ 1264.654692] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0fc21783-a665-46f8-bdde-7d13f7923e03 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.654785] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.654837] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.656749] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.656749] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0fc21783-a665-46f8-bdde-7d13f7923e03',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.657789] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fc21783-a665-46f8-bdde-7d13f7923e03 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.657789] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.658171] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a0268a9-f4a9-474b-a951-1c43b40ac331 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.658171] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a0268a9-f4a9-474b-a951-1c43b40ac331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.658171] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a0268a9-f4a9-474b-a951-1c43b40ac331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.658318] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a0268a9-f4a9-474b-a951-1c43b40ac331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.658393] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a0268a9-f4a9-474b-a951-1c43b40ac331',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.160785] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fc21783-a665-46f8-bdde-7d13f7923e03 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.160918] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.161224] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a0268a9-f4a9-474b-a951-1c43b40ac331 with status ACTIVE [ 1265.161419] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.161530] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.161587] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.162395] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.162508] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.162705] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.162809] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.162875] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.163062] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.163145] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.163328] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.163418] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.163481] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.163614] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.163687] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.163773] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a0268a9-f4a9-474b-a951-1c43b40ac331 is going to be updated. [ 1265.189953] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.190198] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.190249] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.190447] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.190581] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.190747] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a0268a9-f4a9-474b-a951-1c43b40ac331" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.975944] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: SUCCESS [ 1265.976292] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.976343] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.976551] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.976740] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.976936] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.976936] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.977076] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.977160] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.977241] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.977328] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.302039] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-453 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.302256] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-453" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.302388] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-453" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.302652] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-453" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.302933] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.303223] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.303360] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.303600] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.303773] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.303936] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1266.304094] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1266.304223] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1266.304338] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1266.304449] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1266.304565] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1266.304701] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1266.330343] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1266.330585] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1266.330707] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1266.330920] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-453" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.331321] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-bfd19d7e-0d09-4f06-b1c9-31f6bc523646 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.331536] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-bfd19d7e-0d09-4f06-b1c9-31f6bc523646" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.331671] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-bfd19d7e-0d09-4f06-b1c9-31f6bc523646" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.331981] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-bfd19d7e-0d09-4f06-b1c9-31f6bc523646" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.332248] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfd19d7e-0d09-4f06-b1c9-31f6bc523646',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.482082] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.482082] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.482403] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.482403] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.482539] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.482628] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.482692] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.482842] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.482928] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.483066] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.483521] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.483521] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.483521] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.483694] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.483804] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.483917] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.483982] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.484157] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.484240] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.484356] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.484472] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.496133] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 in Status: SUCCESS [ 1266.496445] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.496811] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.497049] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.497247] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.497373] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.497443] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.497595] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.497666] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.497774] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fc21783-a665-46f8-bdde-7d13f7923e03',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.835060] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.835246] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.835290] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.835586] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.835741] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.836061] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.837433] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.837433] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.837433] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.837433] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.837433] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.837433] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.837647] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.838011] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.838011] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.838182] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: bfd19d7e-0d09-4f06-b1c9-31f6bc523646 is going to be updated. [ 1266.862955] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.863271] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.863405] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.863753] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.864076] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.864383] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-bfd19d7e-0d09-4f06-b1c9-31f6bc523646" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.988255] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a927ecd-fa02-4905-9c80-5ef71a14a848: rpc.has_security_group_logging(os_id): False [ 1267.000139] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0fc21783-a665-46f8-bdde-7d13f7923e03',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.009363] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.009560] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.009661] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.009940] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.010097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.010343] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.010449] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.010520] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.010672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.010806] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.010932] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.011072] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.011072] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.011217] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.011288] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.011463] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.011557] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.011618] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.011755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.011870] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.011915] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be updated. [ 1267.086668] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.087011] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.087011] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.087155] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.087346] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.113084] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: IN_PROGRESS for 2s [ 1267.503128] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0fc21783-a665-46f8-bdde-7d13f7923e03',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.611359] env[70520]: INFO networking_nsxv3.common.synchronization [req-98fcbd91-db0a-4368-bcbd-a3d92bfd8f4d req-fc9c5fcb-1ba0-4f3c-b1df-8e1068585f11 service nova] Enqueued Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_rules [ 1267.611632] env[70520]: INFO networking_nsxv3.common.synchronization [req-98fcbd91-db0a-4368-bcbd-a3d92bfd8f4d req-fc9c5fcb-1ba0-4f3c-b1df-8e1068585f11 service nova] Enqueued Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_members [ 1267.611805] env[70520]: INFO networking_nsxv3.common.synchronization [req-98fcbd91-db0a-4368-bcbd-a3d92bfd8f4d req-fc9c5fcb-1ba0-4f3c-b1df-8e1068585f11 service nova] Enqueued Resource ID: bfd19d7e-0d09-4f06-b1c9-31f6bc523646 with Priority: HIGHEST for action port [ 1267.612277] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_rules [ 1267.612435] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_members [ 1267.612524] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfd19d7e-0d09-4f06-b1c9-31f6bc523646 with Priority: HIGHEST for action port [ 1267.612805] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.612970] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.613175] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.613470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.613650] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.614620] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d7f9020-5060-4aaf-81f1-cec3849eacc0 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.614784] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.614899] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.615113] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.615326] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.615474] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.615538] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.615694] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.615777] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.615869] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.616718] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfd19d7e-0d09-4f06-b1c9-31f6bc523646 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.616830] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfd19d7e-0d09-4f06-b1c9-31f6bc523646" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.616955] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfd19d7e-0d09-4f06-b1c9-31f6bc523646" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.617090] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfd19d7e-0d09-4f06-b1c9-31f6bc523646" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.617214] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfd19d7e-0d09-4f06-b1c9-31f6bc523646',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.008591] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.009105] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.009105] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.009105] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.009375] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.009375] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 is going to be updated. [ 1268.044019] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.044250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.044250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.044519] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.044685] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.060522] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 in Status: IN_PROGRESS for 2s [ 1268.119141] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.120351] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d7f9020-5060-4aaf-81f1-cec3849eacc0 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.120557] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.122273] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bfd19d7e-0d09-4f06-b1c9-31f6bc523646 with status ACTIVE [ 1268.122559] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.122705] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.122785] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.123136] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.123309] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.123617] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.123773] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.123879] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.124159] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.124305] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.124622] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.124793] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.124904] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.125206] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.125347] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.125879] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bfd19d7e-0d09-4f06-b1c9-31f6bc523646 is going to be updated. [ 1268.153777] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.154086] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.154086] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.154237] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.154373] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.154524] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfd19d7e-0d09-4f06-b1c9-31f6bc523646" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.622371] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.125065] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.125522] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.125522] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.125522] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.125689] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.125741] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 is going to be updated. [ 1269.147145] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: SUCCESS [ 1269.147519] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.187611] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.187938] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.187938] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.188161] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.188235] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.201698] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: IN_PROGRESS for 2s [ 1270.071784] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 in Status: SUCCESS [ 1270.071784] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.071784] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.071784] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.071784] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.071784] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.071784] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.071784] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.071784] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.071784] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.071784] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0fc21783-a665-46f8-bdde-7d13f7923e03',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.169529] env[70520]: INFO networking_nsxv3.common.synchronization [req-1b41b850-4b06-43a7-aebe-ce3e0a50d7fe req-4d06aedd-3e1b-40f8-947f-4db5984a9ab0 tempest-AttachInterfacesTestJSON-1687744298 tempest-AttachInterfacesTestJSON-1687744298-project-member] Enqueued Resource ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a with Priority: HIGHEST for action security_group_members [ 1270.170411] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a with Priority: HIGHEST for action security_group_members [ 1270.170732] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dcd9459-fa31-46b3-b003-f31c0576d07a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.170867] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.170933] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.171153] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.171312] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.171411] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.171475] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.171635] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.171718] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.171813] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dcd9459-fa31-46b3-b003-f31c0576d07a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.573849] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0fc21783-a665-46f8-bdde-7d13f7923e03',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.679216] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4dcd9459-fa31-46b3-b003-f31c0576d07a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.080160] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0fc21783-a665-46f8-bdde-7d13f7923e03: rpc.has_security_group_logging(os_id): False [ 1271.099024] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.099024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.099024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.099299] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.131593] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.131859] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.131995] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.132077] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.132372] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.132505] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.132636] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 is going to be updated. [ 1271.181928] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4dcd9459-fa31-46b3-b003-f31c0576d07a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.206646] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.206789] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.206865] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.207072] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.207221] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.213487] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: SUCCESS [ 1271.213734] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.213919] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.214149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.214332] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.214446] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.214504] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.214653] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.214731] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.214814] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.214899] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.218040] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 in Status: IN_PROGRESS for 2s [ 1271.685082] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.685082] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.685082] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.685082] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.685082] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.685082] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a is going to be updated. [ 1271.717083] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.728968] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.729175] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.729233] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.729418] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.729565] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.739981] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a in Status: IN_PROGRESS for 2s [ 1272.219684] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d7f9020-5060-4aaf-81f1-cec3849eacc0: rpc.has_security_group_logging(os_id): False [ 1272.238246] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.238457] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.238502] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.238725] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.238817] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.239094] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.239192] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.239256] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.239416] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.239493] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.239611] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 is going to be updated. [ 1272.313430] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.313430] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.313701] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.313738] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.314325] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.328232] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: IN_PROGRESS for 2s [ 1273.235626] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 in Status: SUCCESS [ 1273.236134] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.751615] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a in Status: SUCCESS [ 1273.751809] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.347495] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: SUCCESS [ 1274.347917] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.171067] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1275.171304] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1276.551166] env[70520]: INFO networking_nsxv3.common.synchronization [req-a85f8a7c-71e6-4239-a93f-d416e9b0f41e req-55ead34d-86cb-46c0-a48b-4ddddf8e81e0 tempest-ServersTestJSON-589199853 tempest-ServersTestJSON-589199853-project-member] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1276.551770] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1276.552582] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.552582] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.552582] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.552582] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.552985] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.552985] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.552985] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.553224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.553224] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.553332] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.058719] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.561359] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.979745] env[70520]: INFO networking_nsxv3.common.synchronization [req-9a6e0c24-0206-4f9b-bbbe-08477a69f137 req-84bb4d47-2d38-4600-a287-6eef70800305 tempest-AttachInterfacesTestJSON-1687744298 tempest-AttachInterfacesTestJSON-1687744298-project-member] Enqueued Resource ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a with Priority: HIGHEST for action security_group_members [ 1277.980460] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a with Priority: HIGHEST for action security_group_members [ 1277.980886] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dcd9459-fa31-46b3-b003-f31c0576d07a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.981058] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.981107] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.981349] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.982191] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.982191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.982191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.982191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.982191] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.982191] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dcd9459-fa31-46b3-b003-f31c0576d07a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.064094] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.064363] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.064363] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.064592] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.064689] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.064792] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be updated. [ 1278.099605] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.099818] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.099818] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.100050] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.100255] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.112564] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: IN_PROGRESS for 2s [ 1278.484951] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.485142] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.485197] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.485443] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.485534] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.485735] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.485857] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.485958] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.486255] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.486332] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.486445] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a is going to be updated. [ 1278.517599] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.517772] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.517845] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.518101] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.518847] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.537319] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a in Status: IN_PROGRESS for 2s [ 1280.124780] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: SUCCESS [ 1280.125096] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.546670] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a in Status: SUCCESS [ 1280.546787] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dcd9459-fa31-46b3-b003-f31c0576d07a deletion is rescheduled due to dependency. [ 1280.546896] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dcd9459-fa31-46b3-b003-f31c0576d07a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.814298] env[70520]: INFO networking_nsxv3.common.synchronization [req-f331517c-36d7-46a8-ab74-73cecbe6eeff req-c0a7af6f-441e-430c-9f2a-9ca4ead0a55e tempest-ServersTestJSON-589199853 tempest-ServersTestJSON-589199853-project-member] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1282.814298] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGHEST for action security_group_members [ 1282.814298] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.814298] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.814298] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.814298] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.814298] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.814772] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.814772] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.814772] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.814772] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.814947] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.316934] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.317170] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.317170] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.317406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.317502] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.317691] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.317928] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.317928] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.318215] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.318215] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.318215] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be updated. [ 1283.347599] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.347827] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.347827] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.348025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.348206] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.357622] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: IN_PROGRESS for 2s [ 1284.042666] env[70520]: INFO networking_nsxv3.common.synchronization [None req-937b5936-bb28-4ed2-8685-d783800cd9c7 tempest-AttachInterfacesTestJSON-1687744298 tempest-AttachInterfacesTestJSON-1687744298-project-member] Enqueued Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_members [ 1284.043248] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGHEST for action security_group_members [ 1284.043567] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.043686] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.043758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.043952] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.044263] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.044388] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.044468] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.044691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.044813] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.044876] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.546754] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.546916] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.546995] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.547403] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.547515] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.547823] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.548073] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.549096] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.549096] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.549096] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.549096] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a is going to be updated. [ 1284.577097] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.577295] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.577295] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.577775] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.577934] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.586463] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: IN_PROGRESS for 2s [ 1285.367695] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 in Status: SUCCESS [ 1285.367695] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 deletion is rescheduled due to dependency. [ 1285.367695] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.623868] env[70520]: INFO networking_nsxv3.common.synchronization [req-7b401cd5-ed0d-424e-bbbc-18168402922c req-736bae33-e284-4c89-9da7-70d1dabac713 tempest-ServerActionsTestOtherB-256435736 tempest-ServerActionsTestOtherB-256435736-project-member] Enqueued Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_members [ 1285.624434] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGHEST for action security_group_members [ 1285.624966] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d7f9020-5060-4aaf-81f1-cec3849eacc0 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.625370] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.625709] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.625982] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.626178] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.626302] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.626386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.626586] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.626672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.626786] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.128651] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.129086] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.129086] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.129201] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.129201] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.129409] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.129532] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.129597] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.129747] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.129823] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.129909] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 is going to be updated. [ 1286.180030] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.180030] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.180030] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.180030] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.180030] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.190867] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: IN_PROGRESS for 2s [ 1286.597384] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a in Status: SUCCESS [ 1286.597715] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a deletion is rescheduled due to dependency. [ 1286.597715] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.693021] env[70520]: INFO networking_nsxv3.common.synchronization [req-1ffe24e4-99ff-4fe9-8b3e-5f5d2f068783 req-12de8712-0a8f-4e02-8d99-07c22ec06294 tempest-AttachVolumeNegativeTest-1224878754 tempest-AttachVolumeNegativeTest-1224878754-project-member] Enqueued Resource ID: 583cdb63-56b7-4a80-baa2-c544dc5618c9 with Priority: HIGHEST for action security_group_members [ 1287.693021] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583cdb63-56b7-4a80-baa2-c544dc5618c9 with Priority: HIGHEST for action security_group_members [ 1287.693021] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-583cdb63-56b7-4a80-baa2-c544dc5618c9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.693021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.693021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.693021] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.693021] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.693789] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.694024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.694326] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.694552] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.694753] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('583cdb63-56b7-4a80-baa2-c544dc5618c9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.198180] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.198180] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.198180] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.198180] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.198180] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.198180] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.198180] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.198180] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.198634] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.198634] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.198706] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 583cdb63-56b7-4a80-baa2-c544dc5618c9 is going to be updated. [ 1288.201914] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 in Status: SUCCESS [ 1288.202135] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 deletion is rescheduled due to dependency. [ 1288.202242] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.226562] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.226794] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.226851] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.227129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.227337] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.237053] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 583cdb63-56b7-4a80-baa2-c544dc5618c9 in Status: IN_PROGRESS for 2s [ 1290.249405] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 583cdb63-56b7-4a80-baa2-c544dc5618c9 in Status: SUCCESS [ 1290.249820] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 583cdb63-56b7-4a80-baa2-c544dc5618c9 deletion is rescheduled due to dependency. [ 1290.249820] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.650543] env[70520]: INFO networking_nsxv3.common.synchronization [None req-6cf55754-08bb-4e35-9f20-7342ef9f8af0 None None] Enqueued Resource ID: 3c2dcc54-24aa-4dfc-8c03-3934d49abbdf with Priority: HIGHEST for action port [ 1292.651098] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c2dcc54-24aa-4dfc-8c03-3934d49abbdf with Priority: HIGHEST for action port [ 1292.651484] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c2dcc54-24aa-4dfc-8c03-3934d49abbdf taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.651686] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c2dcc54-24aa-4dfc-8c03-3934d49abbdf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.651805] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c2dcc54-24aa-4dfc-8c03-3934d49abbdf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.652033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c2dcc54-24aa-4dfc-8c03-3934d49abbdf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.652119] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c2dcc54-24aa-4dfc-8c03-3934d49abbdf',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.003257] env[70520]: INFO networking_nsxv3.common.synchronization [None req-08b2cad5-3374-4262-9089-64686dcc400c tempest-AttachVolumeShelveTestJSON-734118648 tempest-AttachVolumeShelveTestJSON-734118648-project-member] Enqueued Resource ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b with Priority: HIGHEST for action security_group_rules [ 1293.005263] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b with Priority: HIGHEST for action security_group_rules [ 1293.005752] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1f012f4-e2e4-4362-ba12-b95acc31ee7b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.005966] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.006104] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.006589] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.006941] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1f012f4-e2e4-4362-ba12-b95acc31ee7b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.084979] env[70520]: INFO networking_nsxv3.common.synchronization [None req-33b2b574-1ab8-469d-8579-c067134e328b tempest-AttachVolumeShelveTestJSON-734118648 tempest-AttachVolumeShelveTestJSON-734118648-project-member] Enqueued Resource ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b with Priority: HIGHEST for action security_group_rules [ 1293.084979] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b with Priority: HIGHEST for action security_group_rules [ 1293.085502] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1f012f4-e2e4-4362-ba12-b95acc31ee7b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.085502] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.157454] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c2dcc54-24aa-4dfc-8c03-3934d49abbdf [ 1293.157454] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.157634] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.157634] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.157877] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.157877] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.157945] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c2dcc54-24aa-4dfc-8c03-3934d49abbdf already deleted. [ 1293.158038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c2dcc54-24aa-4dfc-8c03-3934d49abbdf" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.531355] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.531355] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.531355] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.531607] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.531607] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.531762] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b already deleted. [ 1293.531898] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.532008] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.532202] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.532300] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1f012f4-e2e4-4362-ba12-b95acc31ee7b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.053105] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.053483] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.053483] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.053573] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.053906] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.054016] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b already deleted. [ 1294.054128] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.971540] env[70520]: INFO networking_nsxv3.common.synchronization [None req-978de1e4-1dd0-4362-a92a-575533720295 None None] Enqueued Resource ID: 5b2c5645-a2c8-40b9-82b7-a8a86b8f955c with Priority: HIGHEST for action port [ 1294.971865] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2c5645-a2c8-40b9-82b7-a8a86b8f955c with Priority: HIGHEST for action port [ 1294.972393] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b2c5645-a2c8-40b9-82b7-a8a86b8f955c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.972559] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b2c5645-a2c8-40b9-82b7-a8a86b8f955c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.972559] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b2c5645-a2c8-40b9-82b7-a8a86b8f955c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.972876] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b2c5645-a2c8-40b9-82b7-a8a86b8f955c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.972945] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b2c5645-a2c8-40b9-82b7-a8a86b8f955c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.474708] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b2c5645-a2c8-40b9-82b7-a8a86b8f955c [ 1295.475261] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.475261] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.475261] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.475551] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.475551] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.475551] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b2c5645-a2c8-40b9-82b7-a8a86b8f955c already deleted. [ 1295.475646] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b2c5645-a2c8-40b9-82b7-a8a86b8f955c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.535413] env[70520]: INFO networking_nsxv3.common.synchronization [req-cfb4773c-ebb1-447a-b8a0-b0b3c192d6ef req-854e4f84-e117-464d-9a19-e2b8cf1dd87d tempest-AttachInterfacesUnderV243Test-1671143301 tempest-AttachInterfacesUnderV243Test-1671143301-project-member] Enqueued Resource ID: 16364084-cf78-49e0-9024-a052945a9e8d with Priority: HIGHEST for action security_group_members [ 1297.536215] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16364084-cf78-49e0-9024-a052945a9e8d with Priority: HIGHEST for action security_group_members [ 1297.536561] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-16364084-cf78-49e0-9024-a052945a9e8d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.536690] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.536768] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.536983] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.537180] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.537289] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.537351] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.537520] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.537647] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.537836] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16364084-cf78-49e0-9024-a052945a9e8d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.559917] env[70520]: INFO networking_nsxv3.common.synchronization [req-cfb4773c-ebb1-447a-b8a0-b0b3c192d6ef req-854e4f84-e117-464d-9a19-e2b8cf1dd87d tempest-AttachInterfacesUnderV243Test-1671143301 tempest-AttachInterfacesUnderV243Test-1671143301-project-member] Enqueued Resource ID: 16364084-cf78-49e0-9024-a052945a9e8d with Priority: HIGHEST for action security_group_rules [ 1297.560181] env[70520]: INFO networking_nsxv3.common.synchronization [req-cfb4773c-ebb1-447a-b8a0-b0b3c192d6ef req-854e4f84-e117-464d-9a19-e2b8cf1dd87d tempest-AttachInterfacesUnderV243Test-1671143301 tempest-AttachInterfacesUnderV243Test-1671143301-project-member] Enqueued Resource ID: 16364084-cf78-49e0-9024-a052945a9e8d with Priority: HIGHEST for action security_group_members [ 1297.560274] env[70520]: INFO networking_nsxv3.common.synchronization [req-cfb4773c-ebb1-447a-b8a0-b0b3c192d6ef req-854e4f84-e117-464d-9a19-e2b8cf1dd87d tempest-AttachInterfacesUnderV243Test-1671143301 tempest-AttachInterfacesUnderV243Test-1671143301-project-member] Enqueued Resource ID: abb0f8fe-574b-4c31-a490-168df1f888f7 with Priority: HIGHEST for action port [ 1297.561451] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16364084-cf78-49e0-9024-a052945a9e8d with Priority: HIGHEST for action security_group_rules [ 1297.561451] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16364084-cf78-49e0-9024-a052945a9e8d with Priority: HIGHEST for action security_group_members [ 1297.561451] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abb0f8fe-574b-4c31-a490-168df1f888f7 with Priority: HIGHEST for action port [ 1297.561451] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16364084-cf78-49e0-9024-a052945a9e8d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.561936] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.561936] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.561936] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.561936] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16364084-cf78-49e0-9024-a052945a9e8d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.565321] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-16364084-cf78-49e0-9024-a052945a9e8d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.565321] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.565321] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-abb0f8fe-574b-4c31-a490-168df1f888f7 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.565321] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abb0f8fe-574b-4c31-a490-168df1f888f7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.565321] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abb0f8fe-574b-4c31-a490-168df1f888f7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.565321] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abb0f8fe-574b-4c31-a490-168df1f888f7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.565321] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abb0f8fe-574b-4c31-a490-168df1f888f7',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.040085] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16364084-cf78-49e0-9024-a052945a9e8d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.066421] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-16364084-cf78-49e0-9024-a052945a9e8d taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.066630] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.066801] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port abb0f8fe-574b-4c31-a490-168df1f888f7 with status ACTIVE [ 1298.067038] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.067181] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.067269] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.067541] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.067658] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.067888] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.068037] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.068123] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.068330] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.068466] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.068720] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.068845] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.068929] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.069134] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.069231] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.069342] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: abb0f8fe-574b-4c31-a490-168df1f888f7 is going to be updated. [ 1298.091465] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.091688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.091688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.091843] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.091978] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.092162] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abb0f8fe-574b-4c31-a490-168df1f888f7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.542453] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16364084-cf78-49e0-9024-a052945a9e8d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.044430] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.044662] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.044662] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.044873] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.044962] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.045073] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16364084-cf78-49e0-9024-a052945a9e8d is going to be updated. [ 1299.075595] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.075855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.075855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.075998] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.076164] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.092925] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16364084-cf78-49e0-9024-a052945a9e8d in Status: IN_PROGRESS for 2s [ 1300.428321] env[70520]: INFO networking_nsxv3.common.synchronization [req-dbff9a2d-3073-4a38-8a26-8b2308a945f5 req-a3dbd565-2184-4367-94c5-dcc6e75c9728 tempest-AttachInterfacesUnderV243Test-1671143301 tempest-AttachInterfacesUnderV243Test-1671143301-project-member] Enqueued Resource ID: 16364084-cf78-49e0-9024-a052945a9e8d with Priority: HIGHEST for action security_group_members [ 1300.428321] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16364084-cf78-49e0-9024-a052945a9e8d with Priority: HIGHEST for action security_group_members [ 1300.429049] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-16364084-cf78-49e0-9024-a052945a9e8d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.429170] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.444231] env[70520]: INFO networking_nsxv3.common.synchronization [req-dbff9a2d-3073-4a38-8a26-8b2308a945f5 req-a3dbd565-2184-4367-94c5-dcc6e75c9728 tempest-AttachInterfacesUnderV243Test-1671143301 tempest-AttachInterfacesUnderV243Test-1671143301-project-member] Enqueued Resource ID: 16364084-cf78-49e0-9024-a052945a9e8d with Priority: HIGHEST for action security_group_rules [ 1300.444413] env[70520]: INFO networking_nsxv3.common.synchronization [req-dbff9a2d-3073-4a38-8a26-8b2308a945f5 req-a3dbd565-2184-4367-94c5-dcc6e75c9728 tempest-AttachInterfacesUnderV243Test-1671143301 tempest-AttachInterfacesUnderV243Test-1671143301-project-member] Enqueued Resource ID: 16364084-cf78-49e0-9024-a052945a9e8d with Priority: HIGHEST for action security_group_members [ 1300.444558] env[70520]: INFO networking_nsxv3.common.synchronization [req-dbff9a2d-3073-4a38-8a26-8b2308a945f5 req-a3dbd565-2184-4367-94c5-dcc6e75c9728 tempest-AttachInterfacesUnderV243Test-1671143301 tempest-AttachInterfacesUnderV243Test-1671143301-project-member] Enqueued Resource ID: abb0f8fe-574b-4c31-a490-168df1f888f7 with Priority: HIGHEST for action port [ 1300.445244] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16364084-cf78-49e0-9024-a052945a9e8d with Priority: HIGHEST for action security_group_rules [ 1300.445401] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16364084-cf78-49e0-9024-a052945a9e8d with Priority: HIGHEST for action security_group_members [ 1300.445510] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abb0f8fe-574b-4c31-a490-168df1f888f7 with Priority: HIGHEST for action port [ 1300.445884] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16364084-cf78-49e0-9024-a052945a9e8d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.446028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.446262] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-16364084-cf78-49e0-9024-a052945a9e8d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.446376] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.446585] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-abb0f8fe-574b-4c31-a490-168df1f888f7 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.446715] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abb0f8fe-574b-4c31-a490-168df1f888f7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.446797] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abb0f8fe-574b-4c31-a490-168df1f888f7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.447032] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abb0f8fe-574b-4c31-a490-168df1f888f7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.447141] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abb0f8fe-574b-4c31-a490-168df1f888f7',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.949275] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port abb0f8fe-574b-4c31-a490-168df1f888f7 with status ACTIVE [ 1300.949523] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.949654] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.949721] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.950046] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.950151] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.950342] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.950514] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.950593] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.950738] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.950813] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.950996] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.951101] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.951155] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.951295] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.951365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.951468] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: abb0f8fe-574b-4c31-a490-168df1f888f7 is going to be updated. [ 1300.973907] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.974072] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.974115] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.974333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.974472] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.974870] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abb0f8fe-574b-4c31-a490-168df1f888f7" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.105111] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16364084-cf78-49e0-9024-a052945a9e8d in Status: SUCCESS [ 1301.105386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.105574] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.105800] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.105981] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.106117] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.106181] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.106329] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.106409] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.106501] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16364084-cf78-49e0-9024-a052945a9e8d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.609163] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16364084-cf78-49e0-9024-a052945a9e8d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.112795] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16364084-cf78-49e0-9024-a052945a9e8d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.620291] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.620291] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.620291] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.620291] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.620291] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.620291] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16364084-cf78-49e0-9024-a052945a9e8d is going to be updated. [ 1302.651861] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.652355] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.652355] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.652355] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.652504] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.662755] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16364084-cf78-49e0-9024-a052945a9e8d in Status: IN_PROGRESS for 2s [ 1302.678162] env[70520]: INFO networking_nsxv3.common.synchronization [req-dba54e24-d0e4-452f-ba69-5d0d3df2568f req-86deefcf-b798-408b-a76f-997c1ad420c6 tempest-AttachVolumeShelveTestJSON-734118648 tempest-AttachVolumeShelveTestJSON-734118648-project-member] Enqueued Resource ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b with Priority: HIGHEST for action security_group_members [ 1302.678753] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b with Priority: HIGHEST for action security_group_members [ 1302.679422] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.679563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.679636] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.679884] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.680066] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.680169] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.680225] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.680563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.680563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.680948] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1f012f4-e2e4-4362-ba12-b95acc31ee7b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.979555] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-863 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.979755] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-863" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.979882] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-863" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.980252] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-863" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.980594] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.980798] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.980918] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.981112] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.981261] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.981598] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1302.981856] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1302.982045] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1302.982447] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1302.982447] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1302.982447] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1302.982658] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1303.002681] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1303.002886] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1303.003049] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1303.003230] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-863" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.003542] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-42a78605-52a3-41b5-b647-6ed64dc65b6d taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.003716] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-42a78605-52a3-41b5-b647-6ed64dc65b6d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.003858] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-42a78605-52a3-41b5-b647-6ed64dc65b6d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.004186] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-42a78605-52a3-41b5-b647-6ed64dc65b6d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.004323] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42a78605-52a3-41b5-b647-6ed64dc65b6d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.183129] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.183129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.183129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.183129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.183129] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.183432] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.183432] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.183432] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.183547] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.183580] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.183647] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b already deleted. [ 1303.183730] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.508724] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.508954] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.509182] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.509388] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.509533] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.509681] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 42a78605-52a3-41b5-b647-6ed64dc65b6d not found, creating... [ 1303.509941] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.514043] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.514043] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.514043] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.514043] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.514043] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.514043] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.514043] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.514043] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.514043] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.514043] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 42a78605-52a3-41b5-b647-6ed64dc65b6d is going to be created. [ 1303.532835] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.533105] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.533237] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.533591] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.533727] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.533956] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-42a78605-52a3-41b5-b647-6ed64dc65b6d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.230932] env[70520]: INFO networking_nsxv3.common.synchronization [req-dba54e24-d0e4-452f-ba69-5d0d3df2568f req-1f3facf8-8d88-4e2d-b342-344fe67e13f7 service nova] Enqueued Resource ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b with Priority: HIGHEST for action security_group_rules [ 1304.231211] env[70520]: INFO networking_nsxv3.common.synchronization [req-dba54e24-d0e4-452f-ba69-5d0d3df2568f req-1f3facf8-8d88-4e2d-b342-344fe67e13f7 service nova] Enqueued Resource ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b with Priority: HIGHEST for action security_group_members [ 1304.231336] env[70520]: INFO networking_nsxv3.common.synchronization [req-dba54e24-d0e4-452f-ba69-5d0d3df2568f req-1f3facf8-8d88-4e2d-b342-344fe67e13f7 service nova] Enqueued Resource ID: 42a78605-52a3-41b5-b647-6ed64dc65b6d with Priority: HIGHEST for action port [ 1304.231911] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b with Priority: HIGHEST for action security_group_rules [ 1304.232062] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b with Priority: HIGHEST for action security_group_members [ 1304.232162] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a78605-52a3-41b5-b647-6ed64dc65b6d with Priority: HIGHEST for action port [ 1304.232437] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1f012f4-e2e4-4362-ba12-b95acc31ee7b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.232561] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.232627] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.232867] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.232938] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1f012f4-e2e4-4362-ba12-b95acc31ee7b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.234176] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.234176] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.234282] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.234406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.234551] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.234645] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.234710] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.234841] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.234921] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.235036] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1f012f4-e2e4-4362-ba12-b95acc31ee7b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.236264] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-42a78605-52a3-41b5-b647-6ed64dc65b6d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.236264] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42a78605-52a3-41b5-b647-6ed64dc65b6d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.236264] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42a78605-52a3-41b5-b647-6ed64dc65b6d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.236264] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42a78605-52a3-41b5-b647-6ed64dc65b6d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.236264] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42a78605-52a3-41b5-b647-6ed64dc65b6d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.580785] env[70520]: INFO networking_nsxv3.common.synchronization [req-c2af6fa9-918c-4e70-8ed6-bf406ab3b5a1 req-bb2af4fb-272d-4f16-9510-6ffd7a7596d3 tempest-AttachInterfacesUnderV243Test-1671143301 tempest-AttachInterfacesUnderV243Test-1671143301-project-member] Enqueued Resource ID: 16364084-cf78-49e0-9024-a052945a9e8d with Priority: HIGHEST for action security_group_members [ 1304.581324] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16364084-cf78-49e0-9024-a052945a9e8d with Priority: HIGHEST for action security_group_members [ 1304.581661] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-16364084-cf78-49e0-9024-a052945a9e8d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.581770] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.675641] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16364084-cf78-49e0-9024-a052945a9e8d in Status: SUCCESS [ 1304.675930] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.676159] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.676447] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.676691] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.676843] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.676926] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.677133] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.677234] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.677342] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.677716] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16364084-cf78-49e0-9024-a052945a9e8d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.678533] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.678748] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.678947] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.679114] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.679175] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.679390] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.679570] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.679692] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16364084-cf78-49e0-9024-a052945a9e8d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.738113] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.738333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.738388] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1f012f4-e2e4-4362-ba12-b95acc31ee7b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.741914] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42a78605-52a3-41b5-b647-6ed64dc65b6d with status ACTIVE [ 1304.742849] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.742849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.742849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.742849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.742849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.742849] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.742849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.742849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.743364] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.743364] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.743364] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.743364] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.743506] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.743538] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.744976] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.744976] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42a78605-52a3-41b5-b647-6ed64dc65b6d is going to be updated. [ 1304.766932] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.767063] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.767120] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.767312] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.767418] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.767569] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42a78605-52a3-41b5-b647-6ed64dc65b6d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.181430] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16364084-cf78-49e0-9024-a052945a9e8d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.187294] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.187448] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.187519] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.187824] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.187942] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.188124] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.188228] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.188293] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.188462] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.188523] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.188612] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16364084-cf78-49e0-9024-a052945a9e8d is going to be updated. [ 1305.215109] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.215262] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.215329] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.215542] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.215685] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.224103] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16364084-cf78-49e0-9024-a052945a9e8d in Status: IN_PROGRESS for 2s [ 1305.240504] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1f012f4-e2e4-4362-ba12-b95acc31ee7b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.683494] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16364084-cf78-49e0-9024-a052945a9e8d: rpc.has_security_group_logging(os_id): False [ 1305.709925] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.710214] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.710341] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.710699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.710808] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.711061] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.711156] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.711225] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.711390] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.711563] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.711623] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16364084-cf78-49e0-9024-a052945a9e8d is going to be updated. [ 1305.742759] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.742986] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.743072] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.743352] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.743453] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.743557] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b is going to be created. [ 1305.773603] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.773811] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.773811] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.774031] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.774197] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.786826] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.787073] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.787073] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.787269] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.787413] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.789276] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b in Status: UNINITIALIZED for 2s [ 1305.802889] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16364084-cf78-49e0-9024-a052945a9e8d in Status: IN_PROGRESS for 2s [ 1307.234998] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16364084-cf78-49e0-9024-a052945a9e8d in Status: SUCCESS [ 1307.235454] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16364084-cf78-49e0-9024-a052945a9e8d deletion is rescheduled due to dependency. [ 1307.235454] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.235571] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.235706] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.235894] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.236022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.236089] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.236245] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.236328] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.236422] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16364084-cf78-49e0-9024-a052945a9e8d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.739223] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.739432] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.739511] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.739975] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.739975] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.740250] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.740394] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.740535] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.740777] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.740902] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.741030] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16364084-cf78-49e0-9024-a052945a9e8d is going to be updated. [ 1307.766797] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.766988] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.766988] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.767176] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.767427] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.776098] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16364084-cf78-49e0-9024-a052945a9e8d in Status: IN_PROGRESS for 2s [ 1307.798819] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b in Status: SUCCESS [ 1307.799098] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.799291] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.799528] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.799756] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.799892] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.799959] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.800163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.800246] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.800351] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.800444] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1f012f4-e2e4-4362-ba12-b95acc31ee7b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.817040] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16364084-cf78-49e0-9024-a052945a9e8d in Status: SUCCESS [ 1307.817275] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.817448] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.817683] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.817783] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16364084-cf78-49e0-9024-a052945a9e8d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.302713] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1f012f4-e2e4-4362-ba12-b95acc31ee7b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.337780] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.338040] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.338040] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.338285] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.338383] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.338495] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16364084-cf78-49e0-9024-a052945a9e8d is going to be deleted. [ 1308.401168] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.401388] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.401462] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.401697] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.401784] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.401907] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.805827] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1f012f4-e2e4-4362-ba12-b95acc31ee7b: rpc.has_security_group_logging(os_id): False [ 1308.823938] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.824152] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.824217] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.824433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.824970] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.824970] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.825152] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.825192] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.825364] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.825457] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.825555] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b is going to be created. [ 1308.883220] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.883427] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.883427] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.883632] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.884905] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.894358] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b in Status: IN_PROGRESS for 2s [ 1309.582862] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1309.583232] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1309.787245] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16364084-cf78-49e0-9024-a052945a9e8d in Status: SUCCESS [ 1309.787484] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16364084-cf78-49e0-9024-a052945a9e8d deletion is rescheduled due to dependency. [ 1309.787619] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.787805] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.788097] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.788320] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.788459] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.788521] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.788710] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.788797] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.788912] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16364084-cf78-49e0-9024-a052945a9e8d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.291328] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.291735] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.291735] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.291880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.291963] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.292150] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.292306] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.292306] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.292501] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.292583] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.292618] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16364084-cf78-49e0-9024-a052945a9e8d is going to be deleted. [ 1310.358972] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.359247] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.359247] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.359439] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.359518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.359753] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16364084-cf78-49e0-9024-a052945a9e8d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.906224] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b in Status: SUCCESS [ 1310.906602] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.583792] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1314.584230] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1319.584969] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1319.584969] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1323.205997] env[70520]: INFO networking_nsxv3.common.synchronization [req-3ba54825-05fd-4a62-b5fc-c3be6bef5d23 req-8984b928-7e62-4f5b-a2ce-f4bc3d85dc13 tempest-AttachVolumeTestJSON-1760709661 tempest-AttachVolumeTestJSON-1760709661-project-member] Enqueued Resource ID: f112ebf4-d53d-408e-b028-a56b0ec3f4cb with Priority: HIGHEST for action security_group_members [ 1323.205997] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f112ebf4-d53d-408e-b028-a56b0ec3f4cb with Priority: HIGHEST for action security_group_members [ 1323.205997] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-f112ebf4-d53d-408e-b028-a56b0ec3f4cb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.205997] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.205997] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.207166] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.207166] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.207166] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.207166] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.207166] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.207166] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.207166] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f112ebf4-d53d-408e-b028-a56b0ec3f4cb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.709716] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.709928] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.709928] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.710141] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.710236] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.710433] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.710533] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.710595] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.710839] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.710902] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.710994] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f112ebf4-d53d-408e-b028-a56b0ec3f4cb is going to be updated. [ 1323.738897] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.739173] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.739173] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.739364] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.739509] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.751435] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f112ebf4-d53d-408e-b028-a56b0ec3f4cb in Status: IN_PROGRESS for 2s [ 1325.763635] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f112ebf4-d53d-408e-b028-a56b0ec3f4cb in Status: SUCCESS [ 1325.764158] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f112ebf4-d53d-408e-b028-a56b0ec3f4cb deletion is rescheduled due to dependency. [ 1325.764158] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.206910] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1328.207251] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1330.660522] env[70520]: INFO networking_nsxv3.common.synchronization [req-2d40974b-44d4-4e91-8b7e-a2148e2ea2a3 req-27c3f1dc-9926-4dda-851b-c67b6dc7cba0 tempest-ServerRescueNegativeTestJSON-1807205180 tempest-ServerRescueNegativeTestJSON-1807205180-project-member] Enqueued Resource ID: b93bf2e2-bd30-471b-9e17-a242462b20d9 with Priority: HIGHEST for action security_group_members [ 1330.660522] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b93bf2e2-bd30-471b-9e17-a242462b20d9 with Priority: HIGHEST for action security_group_members [ 1330.660855] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-b93bf2e2-bd30-471b-9e17-a242462b20d9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.660855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.660855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.661017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.661150] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.661251] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.661311] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.661467] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.662132] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.662132] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b93bf2e2-bd30-471b-9e17-a242462b20d9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.164227] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.164388] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.164471] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.164665] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.164755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.164979] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.165093] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.165149] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.165302] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.165411] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.165486] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b93bf2e2-bd30-471b-9e17-a242462b20d9 is going to be updated. [ 1331.196777] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.197010] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.197010] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.197206] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.197346] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.206514] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b93bf2e2-bd30-471b-9e17-a242462b20d9 in Status: IN_PROGRESS for 2s [ 1333.219588] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b93bf2e2-bd30-471b-9e17-a242462b20d9 in Status: SUCCESS [ 1333.220179] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b93bf2e2-bd30-471b-9e17-a242462b20d9 deletion is rescheduled due to dependency. [ 1333.220179] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.660635] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1335.660990] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1336.690361] env[70520]: INFO networking_nsxv3.common.synchronization [req-5f0327af-c19b-4fd9-81a1-1a01dafd768f req-2dba8c02-e55d-4153-88ce-27c967d9231a tempest-ServerActionsTestOtherA-325270290 tempest-ServerActionsTestOtherA-325270290-project-member] Enqueued Resource ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 with Priority: HIGHEST for action security_group_members [ 1336.690949] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 with Priority: HIGHEST for action security_group_members [ 1336.692039] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fc21783-a665-46f8-bdde-7d13f7923e03 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.692180] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.692180] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.692332] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.692492] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.692591] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.692648] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.692831] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.692918] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.693017] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fc21783-a665-46f8-bdde-7d13f7923e03',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.195294] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0fc21783-a665-46f8-bdde-7d13f7923e03',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.698108] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0fc21783-a665-46f8-bdde-7d13f7923e03',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.201089] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.201286] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.201336] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.201544] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.201633] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.201733] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 is going to be updated. [ 1338.231297] env[70520]: INFO networking_nsxv3.common.synchronization [req-4d46530e-79f3-4725-a508-f4521ca7e7a8 req-27bfb040-c7b1-45ff-b78e-d76c85072bbb tempest-ServerActionsTestJSON-420425725 tempest-ServerActionsTestJSON-420425725-project-member] Enqueued Resource ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c with Priority: HIGHEST for action security_group_members [ 1338.232397] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.232527] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.232848] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.232848] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.232919] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.238745] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c with Priority: HIGHEST for action security_group_members [ 1338.238858] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d999f7b-50c9-40ee-b3b1-31ead407224c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.238935] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.238975] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.239164] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.239337] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.239471] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.239534] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.239690] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.241243] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.241243] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d999f7b-50c9-40ee-b3b1-31ead407224c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.249222] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 in Status: IN_PROGRESS for 2s [ 1338.743387] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.743825] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.743825] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.743825] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.743944] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.744155] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.744269] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.744333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.744517] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.744596] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.744684] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c is going to be updated. [ 1338.770652] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.770855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.770855] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.771081] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.771230] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.778885] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c in Status: IN_PROGRESS for 2s [ 1340.260847] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 in Status: SUCCESS [ 1340.261242] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.788597] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c in Status: SUCCESS [ 1340.788807] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c deletion is rescheduled due to dependency. [ 1340.788939] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.740260] env[70520]: INFO networking_nsxv3.common.synchronization [req-4713fec4-6d2d-49b9-a8cb-5e551ae0c185 req-edbdb6ed-d7cb-498b-abf2-e5d8b28dde74 tempest-ServerRescueNegativeTestJSON-1807205180 tempest-ServerRescueNegativeTestJSON-1807205180-project-member] Enqueued Resource ID: e0706cbe-8591-4697-88fe-710ca5564421 with Priority: HIGHEST for action security_group_members [ 1341.740744] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0706cbe-8591-4697-88fe-710ca5564421 with Priority: HIGHEST for action security_group_members [ 1341.741138] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0706cbe-8591-4697-88fe-710ca5564421 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.741215] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.741281] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.741495] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.741643] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.741740] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.741801] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.741952] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.742079] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.742174] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0706cbe-8591-4697-88fe-710ca5564421',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.244046] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0706cbe-8591-4697-88fe-710ca5564421',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.746418] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0706cbe-8591-4697-88fe-710ca5564421',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.248808] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.249105] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.249178] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.249449] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.249552] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.249656] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0706cbe-8591-4697-88fe-710ca5564421 is going to be updated. [ 1343.280126] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.280285] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.280337] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.280551] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.280699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.290522] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0706cbe-8591-4697-88fe-710ca5564421 in Status: IN_PROGRESS for 2s [ 1345.300527] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0706cbe-8591-4697-88fe-710ca5564421 in Status: SUCCESS [ 1345.300950] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.954900] env[70520]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1345.955114] env[70520]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] NSXv3 Agent Agent loop - iteration:3 started [ 1346.281077] env[70520]: INFO networking_nsxv3.common.synchronization [req-8ddc5dc2-2925-416a-ada4-a31ab469c698 req-d2196ffc-f362-4a9e-8c3c-a2fad037a918 tempest-ServerActionsTestJSON-420425725 tempest-ServerActionsTestJSON-420425725-project-member] Enqueued Resource ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c with Priority: HIGHEST for action security_group_members [ 1346.281592] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c with Priority: HIGHEST for action security_group_members [ 1346.281901] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d999f7b-50c9-40ee-b3b1-31ead407224c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.282028] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.282107] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.282308] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.282459] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.282559] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.282617] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.282760] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.282842] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.282932] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d999f7b-50c9-40ee-b3b1-31ead407224c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.554867] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-135 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.555245] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-135" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.555245] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-135" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.555500] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-135" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.555773] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.556137] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.556273] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.556500] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.556644] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.556870] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1346.556986] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1346.557109] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1346.557240] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1346.557369] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1346.557477] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1346.557611] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1346.578632] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1346.578847] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1346.579102] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1346.579458] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-135" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.579922] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-6cc4da48-0859-415d-bde5-03ee7733e633 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.580211] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-6cc4da48-0859-415d-bde5-03ee7733e633" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.580414] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-6cc4da48-0859-415d-bde5-03ee7733e633" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.580844] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-6cc4da48-0859-415d-bde5-03ee7733e633" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.581091] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cc4da48-0859-415d-bde5-03ee7733e633',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.785707] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.785925] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.785925] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.786111] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.786205] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.786412] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.786514] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.786577] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.786732] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.786808] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.786891] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c is going to be updated. [ 1346.811271] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.811466] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.811466] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.811633] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.811767] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.819829] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c in Status: IN_PROGRESS for 2s [ 1347.083873] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.084128] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.084261] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.084557] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.084710] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.084870] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 6cc4da48-0859-415d-bde5-03ee7733e633 not found, creating... [ 1347.085256] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.085436] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.085551] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.085777] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.085919] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.086235] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.086388] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.086504] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.086714] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.086867] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.086991] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 6cc4da48-0859-415d-bde5-03ee7733e633 is going to be created. [ 1347.107376] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.107595] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.107723] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.108037] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.108277] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.108507] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-6cc4da48-0859-415d-bde5-03ee7733e633" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.796523] env[70520]: INFO networking_nsxv3.common.synchronization [req-8ddc5dc2-2925-416a-ada4-a31ab469c698 req-8fe73425-7dfb-49a4-92fb-5b111a9ea72f service nova] Enqueued Resource ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c with Priority: HIGHEST for action security_group_rules [ 1347.796523] env[70520]: INFO networking_nsxv3.common.synchronization [req-8ddc5dc2-2925-416a-ada4-a31ab469c698 req-8fe73425-7dfb-49a4-92fb-5b111a9ea72f service nova] Enqueued Resource ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c with Priority: HIGHEST for action security_group_members [ 1347.796523] env[70520]: INFO networking_nsxv3.common.synchronization [req-8ddc5dc2-2925-416a-ada4-a31ab469c698 req-8fe73425-7dfb-49a4-92fb-5b111a9ea72f service nova] Enqueued Resource ID: 6cc4da48-0859-415d-bde5-03ee7733e633 with Priority: HIGHEST for action port [ 1347.796523] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c with Priority: HIGHEST for action security_group_rules [ 1347.796523] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c with Priority: HIGHEST for action security_group_members [ 1347.796523] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cc4da48-0859-415d-bde5-03ee7733e633 with Priority: HIGHEST for action port [ 1347.796523] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d999f7b-50c9-40ee-b3b1-31ead407224c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.796523] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.796523] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.796523] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.796523] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d999f7b-50c9-40ee-b3b1-31ead407224c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.796523] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d999f7b-50c9-40ee-b3b1-31ead407224c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.796523] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.796523] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-6cc4da48-0859-415d-bde5-03ee7733e633 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.798245] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6cc4da48-0859-415d-bde5-03ee7733e633" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.798245] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6cc4da48-0859-415d-bde5-03ee7733e633" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.798245] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6cc4da48-0859-415d-bde5-03ee7733e633" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.798245] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cc4da48-0859-415d-bde5-03ee7733e633',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.298702] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d999f7b-50c9-40ee-b3b1-31ead407224c taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.298702] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.302672] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6cc4da48-0859-415d-bde5-03ee7733e633 with status ACTIVE [ 1348.302672] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.302672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.302672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.302672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.302672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.302672] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.302672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.302672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.302672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.302672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.303318] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.303318] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.303318] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.303318] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.303318] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.303318] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6cc4da48-0859-415d-bde5-03ee7733e633 is going to be updated. [ 1348.325122] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.325350] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.325350] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.325531] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.325662] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.325819] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6cc4da48-0859-415d-bde5-03ee7733e633" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.831338] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c in Status: SUCCESS [ 1348.831642] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c deletion is rescheduled due to dependency. [ 1348.831800] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.832128] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.832365] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.832566] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.832688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.832758] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.832912] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.833071] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.833144] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d999f7b-50c9-40ee-b3b1-31ead407224c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.335457] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d999f7b-50c9-40ee-b3b1-31ead407224c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.837560] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d999f7b-50c9-40ee-b3b1-31ead407224c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.339875] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.340175] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.340301] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.340668] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.340755] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.340835] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c is going to be updated. [ 1350.375987] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.376242] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.376242] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.376476] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.376673] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.387393] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c in Status: IN_PROGRESS for 2s [ 1351.617573] env[70520]: INFO networking_nsxv3.common.synchronization [req-eefcc5bb-0b26-46f8-950d-88b1ff136fe8 req-41ed216b-aaa3-4f28-954a-4d77c67caa2d tempest-ServerRescueNegativeTestJSON-1807205180 tempest-ServerRescueNegativeTestJSON-1807205180-project-member] Enqueued Resource ID: e0706cbe-8591-4697-88fe-710ca5564421 with Priority: HIGHEST for action security_group_members [ 1351.618506] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0706cbe-8591-4697-88fe-710ca5564421 with Priority: HIGHEST for action security_group_members [ 1351.619094] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0706cbe-8591-4697-88fe-710ca5564421 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.619339] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.619463] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.619781] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.620196] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.620196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.620372] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.620597] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.620737] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.620969] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0706cbe-8591-4697-88fe-710ca5564421',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.124135] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.124397] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.124530] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.124808] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.124915] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.125180] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.125316] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.125377] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.125543] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.125629] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.125724] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0706cbe-8591-4697-88fe-710ca5564421 is going to be updated. [ 1352.156482] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.156727] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.156727] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.156983] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.157181] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.166827] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0706cbe-8591-4697-88fe-710ca5564421 in Status: IN_PROGRESS for 2s [ 1352.402856] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c in Status: SUCCESS [ 1352.403232] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.403420] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.403651] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.403847] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.403980] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.404070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.404204] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.404283] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.404364] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.404470] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d999f7b-50c9-40ee-b3b1-31ead407224c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.907270] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d999f7b-50c9-40ee-b3b1-31ead407224c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.409616] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d999f7b-50c9-40ee-b3b1-31ead407224c: rpc.has_security_group_logging(os_id): False [ 1353.428665] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.428918] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.428918] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.429188] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.429253] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.429586] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.429696] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.429764] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.429914] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.429992] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.430115] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c is going to be updated. [ 1353.497581] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.497845] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.497943] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.498293] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.498633] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.527550] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c in Status: IN_PROGRESS for 2s [ 1353.663574] env[70520]: INFO networking_nsxv3.common.synchronization [req-99b0cd19-069a-4d38-8b41-cc89ae2d2345 req-c3b0583e-1c16-4801-96eb-53703623edbe tempest-ServerActionsTestOtherA-325270290 tempest-ServerActionsTestOtherA-325270290-project-member] Enqueued Resource ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 with Priority: HIGHEST for action security_group_members [ 1353.664727] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 with Priority: HIGHEST for action security_group_members [ 1353.664727] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fc21783-a665-46f8-bdde-7d13f7923e03 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.664727] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.664727] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.666025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.666025] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.666025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.666025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.666025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.666025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.666025] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fc21783-a665-46f8-bdde-7d13f7923e03',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.168492] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.169053] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.169053] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.169053] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.169400] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.169400] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.169584] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.169584] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.169791] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.169880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.169971] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 is going to be updated. [ 1354.181499] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0706cbe-8591-4697-88fe-710ca5564421 in Status: SUCCESS [ 1354.181813] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0706cbe-8591-4697-88fe-710ca5564421 deletion is rescheduled due to dependency. [ 1354.181935] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0706cbe-8591-4697-88fe-710ca5564421" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.212504] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.212667] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.212740] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.212960] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.213122] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.224954] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 in Status: IN_PROGRESS for 2s [ 1355.544792] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c in Status: SUCCESS [ 1355.544792] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.235981] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 in Status: SUCCESS [ 1356.236202] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fc21783-a665-46f8-bdde-7d13f7923e03 deletion is rescheduled due to dependency. [ 1356.236286] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fc21783-a665-46f8-bdde-7d13f7923e03" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.665204] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1358.665557] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1362.118788] env[70520]: INFO networking_nsxv3.common.synchronization [None req-d8487aa1-8bd3-40e2-8bd8-102296f20938 None None] Enqueued Resource ID: 30cd5706-0e08-4733-8dba-6573f38aeea9 with Priority: HIGHEST for action port [ 1362.119359] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30cd5706-0e08-4733-8dba-6573f38aeea9 with Priority: HIGHEST for action port [ 1362.119711] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-30cd5706-0e08-4733-8dba-6573f38aeea9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.119822] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30cd5706-0e08-4733-8dba-6573f38aeea9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.119927] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30cd5706-0e08-4733-8dba-6573f38aeea9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.120286] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30cd5706-0e08-4733-8dba-6573f38aeea9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.120421] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30cd5706-0e08-4733-8dba-6573f38aeea9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.622710] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30cd5706-0e08-4733-8dba-6573f38aeea9 [ 1362.623551] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.623551] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.623551] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.623551] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.623551] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.624025] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30cd5706-0e08-4733-8dba-6573f38aeea9 already deleted. [ 1362.624025] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30cd5706-0e08-4733-8dba-6573f38aeea9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.457727] env[70520]: INFO networking_nsxv3.common.synchronization [None req-1c202b90-eaaa-456e-ac3c-d0d1e9e2aca5 None None] Enqueued Resource ID: 12115a58-73c4-4eeb-af2d-1e8174f5d606 with Priority: HIGHEST for action port [ 1364.458124] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12115a58-73c4-4eeb-af2d-1e8174f5d606 with Priority: HIGHEST for action port [ 1364.458589] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-12115a58-73c4-4eeb-af2d-1e8174f5d606 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.459306] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12115a58-73c4-4eeb-af2d-1e8174f5d606" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.459423] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12115a58-73c4-4eeb-af2d-1e8174f5d606" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.459657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12115a58-73c4-4eeb-af2d-1e8174f5d606" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.459764] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12115a58-73c4-4eeb-af2d-1e8174f5d606',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.962850] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12115a58-73c4-4eeb-af2d-1e8174f5d606 [ 1364.962850] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.962850] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.962850] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.963445] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.963445] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.963445] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12115a58-73c4-4eeb-af2d-1e8174f5d606 already deleted. [ 1364.963445] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12115a58-73c4-4eeb-af2d-1e8174f5d606" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.194770] env[70520]: INFO networking_nsxv3.common.synchronization [req-e9ebed10-b918-43fc-9d4b-451cf649211f req-5ed4b7a1-ccd0-4175-a2bd-d0fdb4ce3bce tempest-ServerAddressesTestJSON-389588560 tempest-ServerAddressesTestJSON-389588560-project-member] Enqueued Resource ID: 76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 with Priority: HIGHEST for action security_group_members [ 1367.195048] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 with Priority: HIGHEST for action security_group_members [ 1367.196333] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.196333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.196333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.196333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.196333] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.196333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.196333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.196333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.196333] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.196764] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76330b09-f2e7-4e8f-9f79-b95e0ba55ad3',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.461183] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-205 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.461383] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-205" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.461514] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-205" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.461830] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-205" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.462105] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.462285] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.462408] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.462632] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.462978] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.462978] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1367.463128] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1367.463211] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1367.463323] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1367.463432] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1367.463609] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1367.463695] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1367.484862] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1367.485147] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1367.485224] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1367.485370] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-205" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.485676] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-d69fa5ef-dda0-4a5b-8cc7-fd67491fbb91 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.485848] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-d69fa5ef-dda0-4a5b-8cc7-fd67491fbb91" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.485967] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-d69fa5ef-dda0-4a5b-8cc7-fd67491fbb91" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.486319] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-d69fa5ef-dda0-4a5b-8cc7-fd67491fbb91" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.486598] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d69fa5ef-dda0-4a5b-8cc7-fd67491fbb91',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.698844] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.699107] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.699107] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.699332] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.699439] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.699643] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.699740] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.699797] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.699949] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.700034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.700116] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 already deleted. [ 1367.700196] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.989140] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.989271] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.989382] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.989667] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.989820] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.989975] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port d69fa5ef-dda0-4a5b-8cc7-fd67491fbb91 not found, creating... [ 1367.990258] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.990422] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.990542] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.990767] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.990906] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.991225] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.991382] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.991538] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.991727] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.991859] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.991998] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: d69fa5ef-dda0-4a5b-8cc7-fd67491fbb91 is going to be created. [ 1368.012829] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.013083] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.013194] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.013579] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.013828] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.014048] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-d69fa5ef-dda0-4a5b-8cc7-fd67491fbb91" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.690860] env[70520]: INFO networking_nsxv3.common.synchronization [req-e9ebed10-b918-43fc-9d4b-451cf649211f req-973a6733-eb84-4d6b-bb7c-8e15736f3b21 service nova] Enqueued Resource ID: 76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 with Priority: HIGHEST for action security_group_rules [ 1368.691209] env[70520]: INFO networking_nsxv3.common.synchronization [req-e9ebed10-b918-43fc-9d4b-451cf649211f req-973a6733-eb84-4d6b-bb7c-8e15736f3b21 service nova] Enqueued Resource ID: 76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 with Priority: HIGHEST for action security_group_members [ 1368.691209] env[70520]: INFO networking_nsxv3.common.synchronization [req-e9ebed10-b918-43fc-9d4b-451cf649211f req-973a6733-eb84-4d6b-bb7c-8e15736f3b21 service nova] Enqueued Resource ID: d69fa5ef-dda0-4a5b-8cc7-fd67491fbb91 with Priority: HIGHEST for action port [ 1368.691421] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 with Priority: HIGHEST for action security_group_rules [ 1368.691552] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 with Priority: HIGHEST for action security_group_members [ 1368.691646] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d69fa5ef-dda0-4a5b-8cc7-fd67491fbb91 with Priority: HIGHEST for action port [ 1368.694480] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.694480] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.694480] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.694480] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.694480] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76330b09-f2e7-4e8f-9f79-b95e0ba55ad3',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.694970] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.695088] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.695158] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.695373] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.695467] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.695545] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.695619] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.695741] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.696024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.696024] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76330b09-f2e7-4e8f-9f79-b95e0ba55ad3',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.700283] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-d69fa5ef-dda0-4a5b-8cc7-fd67491fbb91 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.700451] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d69fa5ef-dda0-4a5b-8cc7-fd67491fbb91" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.700875] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d69fa5ef-dda0-4a5b-8cc7-fd67491fbb91" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.700875] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d69fa5ef-dda0-4a5b-8cc7-fd67491fbb91" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.700875] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d69fa5ef-dda0-4a5b-8cc7-fd67491fbb91',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.202813] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.203062] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.203160] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76330b09-f2e7-4e8f-9f79-b95e0ba55ad3',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.204447] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d69fa5ef-dda0-4a5b-8cc7-fd67491fbb91 with status ACTIVE [ 1369.204935] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.205148] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.205253] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.205528] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.205652] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.205865] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.205994] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.206109] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.206329] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.206449] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.206690] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.206825] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.206984] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.207197] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.207305] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.207492] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d69fa5ef-dda0-4a5b-8cc7-fd67491fbb91 is going to be updated. [ 1369.227729] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.227955] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.228040] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.228246] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.228378] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.228539] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d69fa5ef-dda0-4a5b-8cc7-fd67491fbb91" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.709867] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76330b09-f2e7-4e8f-9f79-b95e0ba55ad3',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.212742] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.212952] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.212952] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.213219] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.213313] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.213422] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 is going to be created. [ 1370.237586] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.237760] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.237829] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.238070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.238228] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.247519] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 in Status: UNINITIALIZED for 2s [ 1372.258527] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 in Status: SUCCESS [ 1372.258527] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.258527] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.258887] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.259195] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.259322] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.259322] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.259456] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.259566] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.259625] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.259689] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76330b09-f2e7-4e8f-9f79-b95e0ba55ad3',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.761628] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.761882] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.761882] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.762372] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.762372] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.762372] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.762372] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.762649] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.762649] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.762737] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.762826] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.762914] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.762973] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.763131] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.763270] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.763353] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.763406] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.763579] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.763729] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.763729] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.763862] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76330b09-f2e7-4e8f-9f79-b95e0ba55ad3',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.265734] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76330b09-f2e7-4e8f-9f79-b95e0ba55ad3: rpc.has_security_group_logging(os_id): False [ 1373.283303] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.283501] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.283501] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.283845] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.283940] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.284160] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.284253] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.284313] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.284465] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.284541] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.284728] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.284819] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.284878] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.285024] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.285101] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.285274] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.285367] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.285425] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.285562] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.285634] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.285715] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 is going to be created. [ 1373.352264] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.352463] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.352463] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.352715] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.352871] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.362854] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 in Status: IN_PROGRESS for 2s [ 1373.692410] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1373.692621] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1375.377464] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 in Status: SUCCESS [ 1375.377926] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.262367] env[70520]: INFO networking_nsxv3.common.synchronization [req-c915c1e9-fe3a-4f57-a369-e9606e6d664c req-915ac848-962f-4dd0-93c0-1c350b3b5b35 tempest-ServerAddressesTestJSON-389588560 tempest-ServerAddressesTestJSON-389588560-project-member] Enqueued Resource ID: 76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 with Priority: HIGHEST for action security_group_members [ 1378.262859] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 with Priority: HIGHEST for action security_group_members [ 1378.263175] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.263290] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.263357] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.263544] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.263691] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.263833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.263833] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.263979] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.265401] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.265522] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76330b09-f2e7-4e8f-9f79-b95e0ba55ad3',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.767473] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.767473] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.767473] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.767952] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.768588] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.768875] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.769078] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.769207] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.769510] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.769632] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.769714] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 is going to be updated. [ 1378.799732] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.799956] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.799956] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.801044] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.801044] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.809251] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 in Status: IN_PROGRESS for 2s [ 1378.892036] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.892206] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.892206] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.892470] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.892544] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.395127] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.898353] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.401199] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1380.401567] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1380.823905] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 in Status: SUCCESS [ 1380.824171] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 deletion is rescheduled due to dependency. [ 1380.824171] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.137111] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.137329] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.137329] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.137620] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.148652] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1381.149566] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.150670] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1381.190628] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.190827] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.190872] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.191070] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.205114] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.205904] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1381.206061] env[70520]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70520) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1381.206162] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1381.245269] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.245569] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.245569] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.245701] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.247032] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.247206] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1381.351968] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.352197] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.352197] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.352416] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.352737] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.353032] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1381.437880] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.438223] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.438223] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.438389] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.438809] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.439021] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:43. [ 1381.439487] env[70520]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'76407410-ab83-45d5-8a78-5480e0efc519', '858fdcda-30cd-409f-85f7-656e8a82042b', '6d7f9020-5060-4aaf-81f1-cec3849eacc0', '76330b09-f2e7-4e8f-9f79-b95e0ba55ad3', 'd1f012f4-e2e4-4362-ba12-b95acc31ee7b', 'b635a150-2303-4a51-9fa7-6a4633e2197a', 'b93bf2e2-bd30-471b-9e17-a242462b20d9', 'f112ebf4-d53d-408e-b028-a56b0ec3f4cb', '468bd631-24dc-43d9-8a0f-93dcf753e208', '583cdb63-56b7-4a80-baa2-c544dc5618c9', '80751702-3cad-4ef3-af48-e8bd866c7e7f', 'd217c04a-3f61-40d6-89c2-a60cc7eb772a', '768b6942-2f10-48d5-8100-f6905c1e030d', '8a927ecd-fa02-4905-9c80-5ef71a14a848', '8af5cf3c-e464-4241-82ec-9fc46dc5ae9f', '9526fc0a-60e6-4c7c-a0b5-b827fe4038aa', '3cc3c352-f711-4ecc-9064-0883727ce3ad', 'b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe', '1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3', '75f6513e-43fa-4780-ac9e-9333cfa1c6a9', '7be95060-a5a7-451a-a570-3386da846ca4', 'da040ed9-9da1-43c9-b672-1e4e957ffa6c', '7c9dafc4-e7ff-4514-ba35-e91b76e57256', '653491db-2944-4ea2-bef7-8e2800a4b41b', 'd202bbfa-42d6-4633-985f-b1007599bbf2', '89cb747a-f330-415b-bfd6-17be7d8807fb', '4cfd4659-cc60-4e40-83b3-09f036d8f58c', 'bc967d33-6d28-4dd5-98c4-22ac5cda2d2e', '9d478320-7685-43e1-8bec-cd33229a3a3f', '817afef8-2b10-4463-a0ad-bc691b622f6f', 'ed51a6f5-8537-40e6-9b09-ff216cb9a61d', '4c90693a-14b7-438f-84ec-4b2ae33515d7', 'f4e36438-996a-4d8f-adfb-5a87b2e7bd82', '4dcd9459-fa31-46b3-b003-f31c0576d07a', 'a23aa860-12db-4b07-ac46-cf4709db7164', '22824640-0730-4b9a-a9ef-9014ef216bc4', '8b22ab11-3a43-4e3c-a9ac-8ee49b487341', '0fc21783-a665-46f8-bdde-7d13f7923e03', '9ce1bad0-f39e-4faf-9a8b-2a9707cf4feb', '17f391db-1908-4d0d-afa1-a1da6f6944f6', 'e0706cbe-8591-4697-88fe-710ca5564421', '5d999f7b-50c9-40ee-b3b1-31ead407224c', '049500dd-1e0c-481a-b7e8-f7bc25741086'} {{(pid=70520) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1381.439487] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1381.458938] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.459171] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.459171] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.459382] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.459468] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.459574] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1381.459645] env[70520]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70520) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1381.459714] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1381.531017] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.531177] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.531249] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.531502] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.532648] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.532915] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1381.532992] env[70520]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70520) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1381.533074] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1381.533144] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1381.533220] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/43 resources of Type:Security Group Rules [ 1381.533290] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 76407410-ab83-45d5-8a78-5480e0efc519 with Priority: HIGH for action security_group_rules [ 1381.533371] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 858fdcda-30cd-409f-85f7-656e8a82042b with Priority: HIGH for action security_group_rules [ 1381.533439] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGH for action security_group_rules [ 1381.533501] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 with Priority: HIGH for action security_group_rules [ 1381.533561] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b with Priority: HIGH for action security_group_rules [ 1381.533655] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b635a150-2303-4a51-9fa7-6a4633e2197a with Priority: HIGH for action security_group_rules [ 1381.533718] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b93bf2e2-bd30-471b-9e17-a242462b20d9 with Priority: HIGH for action security_group_rules [ 1381.533759] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f112ebf4-d53d-408e-b028-a56b0ec3f4cb with Priority: HIGH for action security_group_rules [ 1381.533823] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGH for action security_group_rules [ 1381.533885] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 583cdb63-56b7-4a80-baa2-c544dc5618c9 with Priority: HIGH for action security_group_rules [ 1381.533945] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGH for action security_group_rules [ 1381.534014] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGH for action security_group_rules [ 1381.534079] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 768b6942-2f10-48d5-8100-f6905c1e030d with Priority: HIGH for action security_group_rules [ 1381.534139] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGH for action security_group_rules [ 1381.534201] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f with Priority: HIGH for action security_group_rules [ 1381.534263] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa with Priority: HIGH for action security_group_rules [ 1381.534325] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad with Priority: HIGH for action security_group_rules [ 1381.534387] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe with Priority: HIGH for action security_group_rules [ 1381.534448] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 with Priority: HIGH for action security_group_rules [ 1381.534510] env[70520]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 75f6513e-43fa-4780-ac9e-9333cfa1c6a9 with Priority: HIGH for action security_group_rules [ 1381.534603] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.264231] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1383.264681] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1383.264681] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76407410-ab83-45d5-8a78-5480e0efc519 with Priority: HIGH for action security_group_rules [ 1383.264681] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 with Priority: HIGH for action security_group_rules [ 1383.264681] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b93bf2e2-bd30-471b-9e17-a242462b20d9 with Priority: HIGH for action security_group_rules [ 1383.264879] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f with Priority: HIGH for action security_group_rules [ 1383.264879] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75f6513e-43fa-4780-ac9e-9333cfa1c6a9 with Priority: HIGH for action security_group_rules [ 1383.264962] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 with Priority: HIGH for action security_group_rules [ 1383.265015] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe with Priority: HIGH for action security_group_rules [ 1383.265108] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad with Priority: HIGH for action security_group_rules [ 1383.265287] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 with Priority: HIGH for action security_group_rules [ 1383.265287] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa with Priority: HIGH for action security_group_rules [ 1383.265464] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 768b6942-2f10-48d5-8100-f6905c1e030d with Priority: HIGH for action security_group_rules [ 1383.265464] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a with Priority: HIGH for action security_group_rules [ 1383.265564] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f with Priority: HIGH for action security_group_rules [ 1383.265564] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583cdb63-56b7-4a80-baa2-c544dc5618c9 with Priority: HIGH for action security_group_rules [ 1383.265661] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 with Priority: HIGH for action security_group_rules [ 1383.265719] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b635a150-2303-4a51-9fa7-6a4633e2197a with Priority: HIGH for action security_group_rules [ 1383.265795] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f112ebf4-d53d-408e-b028-a56b0ec3f4cb with Priority: HIGH for action security_group_rules [ 1383.265879] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b with Priority: HIGH for action security_group_rules [ 1383.265963] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858fdcda-30cd-409f-85f7-656e8a82042b with Priority: HIGH for action security_group_rules [ 1383.266061] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 with Priority: HIGH for action security_group_rules [ 1383.266395] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76407410-ab83-45d5-8a78-5480e0efc519 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.266522] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.266581] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.266781] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.266855] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76407410-ab83-45d5-8a78-5480e0efc519',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.267801] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.267912] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.267992] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.268155] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.268227] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d7f9020-5060-4aaf-81f1-cec3849eacc0',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.269150] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b93bf2e2-bd30-471b-9e17-a242462b20d9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.269254] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.269312] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.269466] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.269536] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b93bf2e2-bd30-471b-9e17-a242462b20d9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.270213] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.270324] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.270377] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.270518] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.270584] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8af5cf3c-e464-4241-82ec-9fc46dc5ae9f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.271250] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75f6513e-43fa-4780-ac9e-9333cfa1c6a9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.271396] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.271452] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.271592] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.271659] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75f6513e-43fa-4780-ac9e-9333cfa1c6a9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.272328] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.272474] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.272544] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.272697] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.272767] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.273527] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.273634] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.273699] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.273843] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.273909] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.274569] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cc3c352-f711-4ecc-9064-0883727ce3ad taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.274670] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.274736] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.274889] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.274948] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cc3c352-f711-4ecc-9064-0883727ce3ad',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.275640] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a927ecd-fa02-4905-9c80-5ef71a14a848 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.275702] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.275803] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.275898] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.276023] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a927ecd-fa02-4905-9c80-5ef71a14a848',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.276611] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.276714] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.276771] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.276917] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.276982] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9526fc0a-60e6-4c7c-a0b5-b827fe4038aa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.277880] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-768b6942-2f10-48d5-8100-f6905c1e030d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.277880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.277880] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.278104] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.278104] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('768b6942-2f10-48d5-8100-f6905c1e030d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.278712] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.278817] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.278942] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.279107] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.279179] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d217c04a-3f61-40d6-89c2-a60cc7eb772a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.279841] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80751702-3cad-4ef3-af48-e8bd866c7e7f taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.279940] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.280007] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.280172] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.280236] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80751702-3cad-4ef3-af48-e8bd866c7e7f',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.280877] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-583cdb63-56b7-4a80-baa2-c544dc5618c9 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.281092] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.281160] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.281324] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.281395] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('583cdb63-56b7-4a80-baa2-c544dc5618c9',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.282228] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-468bd631-24dc-43d9-8a0f-93dcf753e208 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.282346] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.282426] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.282586] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.282647] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('468bd631-24dc-43d9-8a0f-93dcf753e208',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.283304] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b635a150-2303-4a51-9fa7-6a4633e2197a taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.283408] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.283474] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.283618] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.283687] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b635a150-2303-4a51-9fa7-6a4633e2197a',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.284340] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f112ebf4-d53d-408e-b028-a56b0ec3f4cb taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.284471] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.284541] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.284691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.284787] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f112ebf4-d53d-408e-b028-a56b0ec3f4cb',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.285496] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1f012f4-e2e4-4362-ba12-b95acc31ee7b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.285602] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.285668] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.285813] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.285884] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1f012f4-e2e4-4362-ba12-b95acc31ee7b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.286528] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-858fdcda-30cd-409f-85f7-656e8a82042b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.286633] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.286692] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.286843] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.286912] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('858fdcda-30cd-409f-85f7-656e8a82042b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.287555] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.287660] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.287812] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.287854] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.287922] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76330b09-f2e7-4e8f-9f79-b95e0ba55ad3',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.310360] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.310581] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.310581] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.310787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.312459] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.312594] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.334782] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.334922] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8af5cf3c-e464-4241-82ec-9fc46dc5ae9f is going to be deleted. [ 1383.336128] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.336390] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.356803] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.356933] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d7f9020-5060-4aaf-81f1-cec3849eacc0 is going to be deleted. [ 1383.393216] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.393386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.393445] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.393671] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.393746] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.393836] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8af5cf3c-e464-4241-82ec-9fc46dc5ae9f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.403244] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.403382] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.403477] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.403681] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.403775] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.404240] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d7f9020-5060-4aaf-81f1-cec3849eacc0" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.866345] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.866715] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.866939] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.867430] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.869791] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.870057] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.872777] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.872944] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.873707] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.876212] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.883909] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.884100] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.884912] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.885069] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.885803] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.885965] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.886715] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.886847] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.887610] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.887840] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.888560] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.888743] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.889742] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.889742] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.890178] env[70520]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1383.890688] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.890814] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.892833] env[70520]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1383.893246] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.893369] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.894388] env[70520]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1383.895132] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.895132] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.895491] env[70520]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1383.895819] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.895943] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.897261] env[70520]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1383.897738] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.898032] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.898633] env[70520]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1383.899063] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.899194] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.899927] env[70520]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1383.900388] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.900826] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.913748] env[70520]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1383.914339] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.914632] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b is going to be deleted. [ 1383.915637] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.915932] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.940089] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.940089] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b635a150-2303-4a51-9fa7-6a4633e2197a is going to be deleted. [ 1383.940089] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.940089] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.961801] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.961931] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 768b6942-2f10-48d5-8100-f6905c1e030d is going to be deleted. [ 1383.962986] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.963238] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.974977] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.975146] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.993855] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.994119] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.997300] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.997442] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3 is going to be deleted. [ 1383.998323] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.998561] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.016854] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.017050] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 583cdb63-56b7-4a80-baa2-c544dc5618c9 is going to be deleted. [ 1384.017928] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.018172] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.040218] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.040422] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.063407] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.063407] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75f6513e-43fa-4780-ac9e-9333cfa1c6a9 is going to be deleted. [ 1384.063407] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.063761] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.101968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.101968] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cc3c352-f711-4ecc-9064-0883727ce3ad is going to be deleted. [ 1384.101968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.101968] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.106752] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.106891] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.137541] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.137681] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.175421] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.175585] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.197321] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.197536] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9526fc0a-60e6-4c7c-a0b5-b827fe4038aa is going to be deleted. [ 1384.198448] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.198681] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.292651] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.292651] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b93bf2e2-bd30-471b-9e17-a242462b20d9 is going to be deleted. [ 1384.292651] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.292651] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.331828] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.332140] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80751702-3cad-4ef3-af48-e8bd866c7e7f is going to be deleted. [ 1384.334625] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.334625] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.335365] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.335496] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.361080] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.361211] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.386109] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.386300] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe is going to be deleted. [ 1384.387343] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.387618] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.434386] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.434512] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.457749] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.457886] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d217c04a-3f61-40d6-89c2-a60cc7eb772a is going to be deleted. [ 1384.458866] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.459120] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.484970] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.485127] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.516973] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.517215] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76407410-ab83-45d5-8a78-5480e0efc519 is going to be deleted. [ 1384.518576] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.518882] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.592921] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.593079] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.595932] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.596104] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a927ecd-fa02-4905-9c80-5ef71a14a848 is going to be deleted. [ 1384.597034] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.597250] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.598629] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.598734] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.691492] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.691644] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 468bd631-24dc-43d9-8a0f-93dcf753e208 is going to be deleted. [ 1384.692734] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.693060] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.707106] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.707286] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.728277] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.728490] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f112ebf4-d53d-408e-b028-a56b0ec3f4cb is going to be deleted. [ 1384.729672] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.729916] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.763331] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.763602] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.806257] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.806421] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76330b09-f2e7-4e8f-9f79-b95e0ba55ad3 is going to be deleted. [ 1384.807341] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.807621] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.822168] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.822168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.849416] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-863 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.849612] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-863" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.849739] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-863" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.850045] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-863" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.850790] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.850976] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.851127] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.851403] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.851556] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.851776] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1384.851896] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1384.852016] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1384.852132] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1384.852251] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1384.852402] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1384.852540] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1384.875700] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.875859] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 858fdcda-30cd-409f-85f7-656e8a82042b is going to be deleted. [ 1384.876790] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.877016] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.877110] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.877241] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.877397] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.877556] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.877633] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.877744] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b635a150-2303-4a51-9fa7-6a4633e2197a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.878247] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.878411] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.878493] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.878624] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-768b6942-2f10-48d5-8100-f6905c1e030d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.878753] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.878895] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.878969] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.879163] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cdc3a4d-c2d4-4c62-b1d7-03b8071202e3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.879299] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.879378] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.879419] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.879520] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-583cdb63-56b7-4a80-baa2-c544dc5618c9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.879644] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.879783] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.879857] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.879977] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75f6513e-43fa-4780-ac9e-9333cfa1c6a9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.880115] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.880254] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.880325] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.880430] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cc3c352-f711-4ecc-9064-0883727ce3ad" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.880552] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.880738] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.880819] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.880930] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9526fc0a-60e6-4c7c-a0b5-b827fe4038aa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.881067] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.881209] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.881282] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.881479] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b93bf2e2-bd30-471b-9e17-a242462b20d9" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.881601] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.881752] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.881820] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.881928] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80751702-3cad-4ef3-af48-e8bd866c7e7f" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.882062] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.882203] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.882278] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.882410] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8eb1305-9cc9-4fd4-9438-61ec2b21f7fe" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.882618] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.882765] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.882840] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.882949] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d217c04a-3f61-40d6-89c2-a60cc7eb772a" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.883083] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.883222] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.883296] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.883405] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76407410-ab83-45d5-8a78-5480e0efc519" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.883531] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.883738] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.883821] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.883929] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a927ecd-fa02-4905-9c80-5ef71a14a848" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.884062] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.884203] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.884274] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.884378] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-468bd631-24dc-43d9-8a0f-93dcf753e208" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.901528] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.901688] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.901750] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.902040] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.902099] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.902181] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f112ebf4-d53d-408e-b028-a56b0ec3f4cb" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.904086] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1384.904259] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.052 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1384.904404] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1384.904630] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-863" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.904951] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-42a78605-52a3-41b5-b647-6ed64dc65b6d taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.905139] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-42a78605-52a3-41b5-b647-6ed64dc65b6d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.905261] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-42a78605-52a3-41b5-b647-6ed64dc65b6d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.905509] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-42a78605-52a3-41b5-b647-6ed64dc65b6d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.905645] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42a78605-52a3-41b5-b647-6ed64dc65b6d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.952114] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.952351] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.952351] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.952549] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.952631] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.952849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76330b09-f2e7-4e8f-9f79-b95e0ba55ad3" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.008238] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.008457] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.008457] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.008674] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.008763] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.008884] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-858fdcda-30cd-409f-85f7-656e8a82042b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.408395] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.408792] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.408792] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.409064] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.409226] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.409539] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.409705] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.409825] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.410073] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.410217] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.410559] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.410675] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.410794] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.411049] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.411210] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.411380] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 42a78605-52a3-41b5-b647-6ed64dc65b6d is going to be updated. [ 1385.435586] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.436516] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.436516] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.436516] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.436516] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.436731] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-42a78605-52a3-41b5-b647-6ed64dc65b6d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.066425] env[70520]: INFO networking_nsxv3.common.synchronization [req-81e17ebb-32a1-401a-ad9a-f8a835a88ab4 req-91f4f746-c69f-4ed7-aac5-7b71650353f5 service nova] Enqueued Resource ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b with Priority: HIGHEST for action security_group_rules [ 1386.066615] env[70520]: INFO networking_nsxv3.common.synchronization [req-81e17ebb-32a1-401a-ad9a-f8a835a88ab4 req-91f4f746-c69f-4ed7-aac5-7b71650353f5 service nova] Enqueued Resource ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b with Priority: HIGHEST for action security_group_members [ 1386.066758] env[70520]: INFO networking_nsxv3.common.synchronization [req-81e17ebb-32a1-401a-ad9a-f8a835a88ab4 req-91f4f746-c69f-4ed7-aac5-7b71650353f5 service nova] Enqueued Resource ID: 42a78605-52a3-41b5-b647-6ed64dc65b6d with Priority: HIGHEST for action port [ 1386.066986] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b with Priority: HIGHEST for action security_group_rules [ 1386.067129] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b with Priority: HIGHEST for action security_group_members [ 1386.067224] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a78605-52a3-41b5-b647-6ed64dc65b6d with Priority: HIGHEST for action port [ 1386.067779] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1f012f4-e2e4-4362-ba12-b95acc31ee7b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.067904] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.067965] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.068176] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.068247] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1f012f4-e2e4-4362-ba12-b95acc31ee7b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.069059] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.069174] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.069247] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.069402] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.069705] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.069705] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.069705] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.069875] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.070022] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.070022] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1f012f4-e2e4-4362-ba12-b95acc31ee7b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.070694] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-42a78605-52a3-41b5-b647-6ed64dc65b6d taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.070801] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42a78605-52a3-41b5-b647-6ed64dc65b6d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.070871] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42a78605-52a3-41b5-b647-6ed64dc65b6d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.071392] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42a78605-52a3-41b5-b647-6ed64dc65b6d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.071392] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42a78605-52a3-41b5-b647-6ed64dc65b6d',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.572570] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1f012f4-e2e4-4362-ba12-b95acc31ee7b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.573655] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.573786] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.573974] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42a78605-52a3-41b5-b647-6ed64dc65b6d with status ACTIVE [ 1386.574150] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.574256] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.574315] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.574504] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.574590] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.574750] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.574844] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.574900] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.575059] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.575135] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.575302] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.575396] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.575459] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.575746] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.575746] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.575746] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42a78605-52a3-41b5-b647-6ed64dc65b6d is going to be updated. [ 1386.597227] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.597227] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.597227] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.597398] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.597524] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.597732] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42a78605-52a3-41b5-b647-6ed64dc65b6d" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.078426] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1f012f4-e2e4-4362-ba12-b95acc31ee7b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.581640] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.582141] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.582141] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.582141] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.582327] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.582327] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b is going to be updated. [ 1387.626026] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.626275] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.626275] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.626434] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.626581] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.638649] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b in Status: IN_PROGRESS for 2s [ 1389.658062] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b in Status: SUCCESS [ 1389.658548] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.658548] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.658908] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.659180] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.659386] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.659509] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.659770] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.659914] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.660101] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.660267] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1f012f4-e2e4-4362-ba12-b95acc31ee7b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.162624] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1f012f4-e2e4-4362-ba12-b95acc31ee7b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.664949] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1f012f4-e2e4-4362-ba12-b95acc31ee7b: rpc.has_security_group_logging(os_id): False [ 1390.686353] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.686612] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.686697] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.686953] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.687094] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.687437] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.687578] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.687639] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.687787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.687886] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.688021] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b is going to be created. [ 1390.768110] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.768420] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.768420] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.768611] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.768778] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.798414] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b in Status: IN_PROGRESS for 2s [ 1391.068104] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1391.068206] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1392.814832] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b in Status: SUCCESS [ 1392.815236] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.069902] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1396.070339] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1401.070857] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1401.071262] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1406.072403] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1406.072803] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1408.990142] env[70520]: INFO networking_nsxv3.common.synchronization [req-6bb33ca0-3afe-4a48-9f15-64b134515c75 req-c38631bf-d491-4d99-8de4-08cb94cbafa6 tempest-ServerActionsTestJSON-420425725 tempest-ServerActionsTestJSON-420425725-project-member] Enqueued Resource ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c with Priority: HIGHEST for action security_group_members [ 1408.990663] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c with Priority: HIGHEST for action security_group_members [ 1408.991787] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d999f7b-50c9-40ee-b3b1-31ead407224c taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.991787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.991787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.991787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.991787] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.991787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.991787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.992496] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.992496] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.992496] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d999f7b-50c9-40ee-b3b1-31ead407224c',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.495170] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.495364] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.495494] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.495723] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.519281] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.519531] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.519664] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.519720] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.519928] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.520029] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.520124] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c is going to be updated. [ 1409.548451] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.548792] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.548792] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.548916] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.549014] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.558740] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c in Status: IN_PROGRESS for 2s [ 1411.568515] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c in Status: SUCCESS [ 1411.568850] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d999f7b-50c9-40ee-b3b1-31ead407224c deletion is rescheduled due to dependency. [ 1411.568850] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d999f7b-50c9-40ee-b3b1-31ead407224c" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.991705] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1413.992043] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1418.992842] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1418.993250] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1423.994399] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1423.994687] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1428.995919] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1428.996335] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1433.997392] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1433.997760] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1438.998399] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1438.998729] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1442.967059] env[70520]: INFO networking_nsxv3.common.synchronization [req-0a79c79c-ad39-4fab-9721-6e4945ecf805 req-e441d0d7-3f9a-4ec7-b5d5-4fd94c693b9c tempest-AttachVolumeShelveTestJSON-734118648 tempest-AttachVolumeShelveTestJSON-734118648-project-member] Enqueued Resource ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b with Priority: HIGHEST for action security_group_members [ 1442.967235] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b with Priority: HIGHEST for action security_group_members [ 1442.967513] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.967649] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.967720] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.967939] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.968737] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.968737] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.968737] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.968737] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.968737] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.968737] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1f012f4-e2e4-4362-ba12-b95acc31ee7b',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1443.470813] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.470813] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.470813] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.471071] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.471071] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.471273] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.471373] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.471433] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.471582] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.471657] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.471741] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b is going to be updated. [ 1443.532516] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.532713] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.532713] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.532951] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.533110] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.542713] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b in Status: IN_PROGRESS for 2s [ 1445.557726] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b in Status: IN_PROGRESS for 4s [ 1447.569300] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b in Status: SUCCESS [ 1447.569690] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1f012f4-e2e4-4362-ba12-b95acc31ee7b deletion is rescheduled due to dependency. [ 1447.569690] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1f012f4-e2e4-4362-ba12-b95acc31ee7b" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.878789] env[70520]: INFO networking_nsxv3.common.synchronization [None req-12c61232-937b-40aa-9806-398684a09134 tempest-AttachVolumeShelveTestJSON-734118648 tempest-AttachVolumeShelveTestJSON-734118648-project-member] Enqueued Resource ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa with Priority: HIGHEST for action security_group_rules [ 1447.879365] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa with Priority: HIGHEST for action security_group_rules [ 1447.879667] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48fc7a28-2fa3-437c-920d-cb3bd48f99fa taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.879781] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.879862] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.880168] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.880252] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48fc7a28-2fa3-437c-920d-cb3bd48f99fa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1447.946681] env[70520]: INFO networking_nsxv3.common.synchronization [None req-ab1ff9ad-b031-4e0a-9b6c-5638d33b14f2 tempest-AttachVolumeShelveTestJSON-734118648 tempest-AttachVolumeShelveTestJSON-734118648-project-member] Enqueued Resource ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa with Priority: HIGHEST for action security_group_rules [ 1447.946681] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa with Priority: HIGHEST for action security_group_rules [ 1447.946681] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48fc7a28-2fa3-437c-920d-cb3bd48f99fa taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.946681] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.403044] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.403044] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.403044] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.403265] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.403300] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.403418] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa already deleted. [ 1448.403513] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.403659] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.403841] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.403950] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48fc7a28-2fa3-437c-920d-cb3bd48f99fa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1448.923896] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.924283] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.924283] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.924283] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.924380] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.924479] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa already deleted. [ 1448.924570] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.948147] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1452.948415] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1453.151580] env[70520]: INFO networking_nsxv3.common.synchronization [req-f4d22808-04ed-4c96-a65a-ade28ed6024b req-809ae087-13f9-437e-a968-b481beebadf4 tempest-AttachVolumeShelveTestJSON-734118648 tempest-AttachVolumeShelveTestJSON-734118648-project-member] Enqueued Resource ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa with Priority: HIGHEST for action security_group_members [ 1453.152061] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa with Priority: HIGHEST for action security_group_members [ 1453.152386] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.152510] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.152575] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.152813] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.152958] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.153059] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.153127] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.153263] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.153332] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.153429] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48fc7a28-2fa3-437c-920d-cb3bd48f99fa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1453.423126] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-863 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.423377] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-863" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.423485] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-863" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.423766] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-863" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.424058] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.424273] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.424346] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.424772] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.424821] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.425059] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1453.425369] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1453.425369] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1453.425541] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1453.425639] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1453.425754] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1453.426126] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1453.450314] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1453.450515] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1453.450665] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1453.450922] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-863" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.451274] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-6df0c641-57de-4036-a924-a4be942ec2b5 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.451457] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-6df0c641-57de-4036-a924-a4be942ec2b5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.451582] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-6df0c641-57de-4036-a924-a4be942ec2b5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.451926] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-6df0c641-57de-4036-a924-a4be942ec2b5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.452111] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6df0c641-57de-4036-a924-a4be942ec2b5',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1453.655771] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.656045] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.656115] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.656321] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.656418] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.656661] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.656800] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.656893] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.657159] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.657293] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.657416] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa already deleted. [ 1453.657561] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.954889] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.955276] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.955276] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.955732] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.955732] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.955847] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Segment Port 6df0c641-57de-4036-a924-a4be942ec2b5 not found, creating... [ 1453.956096] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.956264] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.956426] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.956660] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.956797] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.957092] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.957254] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.957383] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.957593] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.957729] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.957979] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 6df0c641-57de-4036-a924-a4be942ec2b5 is going to be created. [ 1453.981113] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.981375] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.981454] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.981730] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.981961] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.982244] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-6df0c641-57de-4036-a924-a4be942ec2b5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.649562] env[70520]: INFO networking_nsxv3.common.synchronization [req-f4d22808-04ed-4c96-a65a-ade28ed6024b req-97ae3ea4-ecb4-4571-b783-c6de380f823b service nova] Enqueued Resource ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa with Priority: HIGHEST for action security_group_rules [ 1454.649731] env[70520]: INFO networking_nsxv3.common.synchronization [req-f4d22808-04ed-4c96-a65a-ade28ed6024b req-97ae3ea4-ecb4-4571-b783-c6de380f823b service nova] Enqueued Resource ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa with Priority: HIGHEST for action security_group_members [ 1454.649873] env[70520]: INFO networking_nsxv3.common.synchronization [req-f4d22808-04ed-4c96-a65a-ade28ed6024b req-97ae3ea4-ecb4-4571-b783-c6de380f823b service nova] Enqueued Resource ID: 6df0c641-57de-4036-a924-a4be942ec2b5 with Priority: HIGHEST for action port [ 1454.650442] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa with Priority: HIGHEST for action security_group_rules [ 1454.650594] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa with Priority: HIGHEST for action security_group_members [ 1454.650690] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6df0c641-57de-4036-a924-a4be942ec2b5 with Priority: HIGHEST for action port [ 1454.650939] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48fc7a28-2fa3-437c-920d-cb3bd48f99fa taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.651067] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.651146] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.651358] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.651443] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48fc7a28-2fa3-437c-920d-cb3bd48f99fa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1454.652728] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.652831] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.653013] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.653090] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.653243] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.653379] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.653379] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.653542] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.653614] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.653713] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48fc7a28-2fa3-437c-920d-cb3bd48f99fa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1454.654601] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-6df0c641-57de-4036-a924-a4be942ec2b5 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.654601] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6df0c641-57de-4036-a924-a4be942ec2b5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.654601] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6df0c641-57de-4036-a924-a4be942ec2b5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.654959] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6df0c641-57de-4036-a924-a4be942ec2b5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.654959] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6df0c641-57de-4036-a924-a4be942ec2b5',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1455.156997] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48fc7a28-2fa3-437c-920d-cb3bd48f99fa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1455.158169] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.158332] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.159807] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6df0c641-57de-4036-a924-a4be942ec2b5 with status ACTIVE [ 1455.159997] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.160125] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.160182] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.160383] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.160472] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.160639] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.160735] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.160797] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.160941] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.161112] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.161304] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.161395] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.161457] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.161606] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.161679] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.161764] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6df0c641-57de-4036-a924-a4be942ec2b5 is going to be updated. [ 1455.182251] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.182424] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.182482] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.182651] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.182844] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.183033] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6df0c641-57de-4036-a924-a4be942ec2b5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.660096] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48fc7a28-2fa3-437c-920d-cb3bd48f99fa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1456.163509] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1456.163899] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1456.163899] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1456.164045] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1456.164045] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.164193] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa is going to be created. [ 1456.189202] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1456.189451] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1456.189451] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1456.189605] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1456.189759] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.199600] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa in Status: UNINITIALIZED for 2s [ 1458.210872] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa in Status: SUCCESS [ 1458.211227] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.211322] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.211495] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.211685] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.211800] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.211863] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.212017] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.212134] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.212223] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.212314] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48fc7a28-2fa3-437c-920d-cb3bd48f99fa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1458.714369] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48fc7a28-2fa3-437c-920d-cb3bd48f99fa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1459.217127] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48fc7a28-2fa3-437c-920d-cb3bd48f99fa: rpc.has_security_group_logging(os_id): False [ 1459.236011] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.236194] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.236227] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.236449] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.236539] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.236800] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.236898] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.236964] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.237134] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.237211] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.237296] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa is going to be created. [ 1459.298903] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.299188] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.299188] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.299376] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.299550] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.311306] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa in Status: IN_PROGRESS for 2s [ 1459.652065] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1459.652065] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1461.326459] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa in Status: SUCCESS [ 1461.326825] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.653257] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1464.653257] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1469.654418] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1469.654418] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1474.655933] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1474.656321] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1479.657777] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1479.657777] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1484.658391] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1484.658781] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1489.659586] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1489.659985] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1494.660963] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1494.661363] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1499.662454] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1499.662815] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1504.664442] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1504.664885] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1509.666364] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1509.666735] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1514.667317] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1514.667317] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1519.668559] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1519.668559] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1524.669808] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1524.670201] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1526.612038] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock network-863 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.612038] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "network-863" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.612038] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "network-863" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.612403] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "network-863" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.612484] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.612628] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.612772] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.613014] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.613169] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.613399] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1526.613519] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] NeedRegenerationException {{(pid=70520) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1526.613634] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] no value, waiting for create lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1526.613747] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] value creation lock acquired {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1526.613855] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] No value present for key: 'zone-id' {{(pid=70520) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1526.613968] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Calling creation function for not-yet-present value {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1526.614160] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1526.646424] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1526.646642] env[70520]: DEBUG dogpile.cache.region [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=70520) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1526.646727] env[70520]: DEBUG dogpile.lock [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Released creation lock {{(pid=70520) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1526.646882] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "network-863" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.647261] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock port-6df0c641-57de-4036-a924-a4be942ec2b5 taken with stack trace [, , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.647389] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "port-6df0c641-57de-4036-a924-a4be942ec2b5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.647509] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "port-6df0c641-57de-4036-a924-a4be942ec2b5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.647776] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "port-6df0c641-57de-4036-a924-a4be942ec2b5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.647944] env[70520]: DEBUG networking_nsxv3.api.rpc [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6df0c641-57de-4036-a924-a4be942ec2b5',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1527.150800] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.151072] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.151215] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.151507] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.151660] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.151966] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.152143] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.152276] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.152512] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.152654] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.152982] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.153159] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.153278] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.153490] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.153622] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.153772] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Resource: SegmentPort with ID: 6df0c641-57de-4036-a924-a4be942ec2b5 is going to be updated. [ 1527.176526] env[70520]: DEBUG networking_nsxv3.common.locking [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.176731] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.176855] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.177145] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.177340] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.177559] env[70520]: DEBUG oslo_concurrency.lockutils [None req-7c787f50-7043-4dff-bae5-ae5c01021796 None None] Releasing lock "port-6df0c641-57de-4036-a924-a4be942ec2b5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.823234] env[70520]: INFO networking_nsxv3.common.synchronization [req-370c7b4e-e302-408d-b046-a8840b6694c8 req-2bf59fdb-5ceb-43e4-83b4-71c83c1b0573 service nova] Enqueued Resource ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa with Priority: HIGHEST for action security_group_rules [ 1527.823549] env[70520]: INFO networking_nsxv3.common.synchronization [req-370c7b4e-e302-408d-b046-a8840b6694c8 req-2bf59fdb-5ceb-43e4-83b4-71c83c1b0573 service nova] Enqueued Resource ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa with Priority: HIGHEST for action security_group_members [ 1527.823549] env[70520]: INFO networking_nsxv3.common.synchronization [req-370c7b4e-e302-408d-b046-a8840b6694c8 req-2bf59fdb-5ceb-43e4-83b4-71c83c1b0573 service nova] Enqueued Resource ID: 6df0c641-57de-4036-a924-a4be942ec2b5 with Priority: HIGHEST for action port [ 1527.823770] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa with Priority: HIGHEST for action security_group_rules [ 1527.823900] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa with Priority: HIGHEST for action security_group_members [ 1527.823998] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6df0c641-57de-4036-a924-a4be942ec2b5 with Priority: HIGHEST for action port [ 1527.824927] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48fc7a28-2fa3-437c-920d-cb3bd48f99fa taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.825090] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.825172] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.825373] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.825454] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48fc7a28-2fa3-437c-920d-cb3bd48f99fa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1527.826275] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.826390] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.826456] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.826617] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.826808] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.826856] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.826898] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.827060] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.827156] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.827230] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48fc7a28-2fa3-437c-920d-cb3bd48f99fa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1527.827919] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock port-6df0c641-57de-4036-a924-a4be942ec2b5 taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.828038] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6df0c641-57de-4036-a924-a4be942ec2b5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.828262] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6df0c641-57de-4036-a924-a4be942ec2b5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.828262] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6df0c641-57de-4036-a924-a4be942ec2b5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.828320] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6df0c641-57de-4036-a924-a4be942ec2b5',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1528.330328] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48fc7a28-2fa3-437c-920d-cb3bd48f99fa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1528.331358] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.331496] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.331654] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6df0c641-57de-4036-a924-a4be942ec2b5 with status ACTIVE [ 1528.331972] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.332101] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.332176] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.332374] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.332537] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.332719] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.332841] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.332959] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.333141] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.333218] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.333400] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.333495] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.333551] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.333691] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.333800] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.333857] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6df0c641-57de-4036-a924-a4be942ec2b5 is going to be updated. [ 1528.354140] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.354301] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.354301] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.354502] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.354636] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.354794] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6df0c641-57de-4036-a924-a4be942ec2b5" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.836348] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48fc7a28-2fa3-437c-920d-cb3bd48f99fa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1529.339070] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.339295] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.339295] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.339524] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.339618] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.339752] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa is going to be updated. [ 1529.377117] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.377318] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.377318] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.377504] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.377648] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.387380] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa in Status: IN_PROGRESS for 2s [ 1531.398655] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa in Status: SUCCESS [ 1531.399027] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.399076] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.399276] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.399497] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.399623] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.399679] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.399845] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.399920] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.400051] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.400207] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48fc7a28-2fa3-437c-920d-cb3bd48f99fa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.902381] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48fc7a28-2fa3-437c-920d-cb3bd48f99fa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1532.404472] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48fc7a28-2fa3-437c-920d-cb3bd48f99fa: rpc.has_security_group_logging(os_id): False [ 1532.424221] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.424409] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.424507] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.424804] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.424950] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.425318] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.425450] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.425538] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.425746] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.425849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.425996] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa is going to be updated. [ 1532.487516] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.487722] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.487787] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.488087] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.488234] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.505063] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa in Status: IN_PROGRESS for 2s [ 1532.825194] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1532.825395] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1534.522277] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa in Status: SUCCESS [ 1534.522708] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.826796] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1537.827173] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1542.828443] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1542.828831] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1547.830416] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1547.830829] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1552.831628] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1552.832052] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1557.833115] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1557.833474] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1562.835160] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1562.835582] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1567.837169] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1567.837567] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1572.838773] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1572.839275] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1577.840470] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1577.840834] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1578.659683] env[70520]: INFO networking_nsxv3.common.synchronization [req-db8e3866-8051-4b6d-9a04-2b32d47b01bf req-08bbfc9b-efae-4b5e-b1a5-b91e49d13bba tempest-AttachVolumeShelveTestJSON-734118648 tempest-AttachVolumeShelveTestJSON-734118648-project-member] Enqueued Resource ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa with Priority: HIGHEST for action security_group_members [ 1578.660200] env[70520]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa with Priority: HIGHEST for action security_group_members [ 1578.660522] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa taken with stack trace [, , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.660634] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.660703] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.660900] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.661056] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.661140] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.661211] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.661428] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.661507] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.661561] env[70520]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48fc7a28-2fa3-437c-920d-cb3bd48f99fa',) {} {{(pid=70520) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1579.163869] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.164283] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.164283] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.164283] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.164387] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.164545] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.164643] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.164745] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.164849] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.164922] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.165013] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa is going to be updated. [ 1579.193764] env[70520]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.193945] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.193945] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.194185] env[70520]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.194320] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.206349] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa in Status: IN_PROGRESS for 2s [ 1581.217994] env[70520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa in Status: SUCCESS [ 1581.218431] env[70520]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48fc7a28-2fa3-437c-920d-cb3bd48f99fa deletion is rescheduled due to dependency. [ 1581.218431] env[70520]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48fc7a28-2fa3-437c-920d-cb3bd48f99fa" {{(pid=70520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.661177] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1583.661599] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1585.955891] env[70520]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1585.956300] env[70520]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-42dcfd6d-1746-4968-a3c5-208265f4598f None None] NSXv3 Agent Agent loop - iteration:4 started [ 1588.662527] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1588.662904] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1593.663646] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1593.664031] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1598.664855] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1598.665223] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1603.666167] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1603.666525] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1608.667854] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1608.668229] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1613.668880] env[70520]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1613.669285] env[70520]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0